[ 521.128077] env[65465]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 521.128077] env[65465]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 522.118753] env[65553]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.118753] env[65553]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 523.674186] env[65553]: INFO neutron.common.config [-] Logging enabled! [ 523.674538] env[65553]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev8 [ 523.674727] env[65553]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65553) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 523.675040] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 523.675136] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 523.675983] env[65553]: WARNING oslo_policy.policy [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 523.676216] env[65553]: WARNING oslo_policy.policy [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 523.677919] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] VMware NSXv3 Agent initialized successfully. [ 523.678277] env[65553]: DEBUG oslo_concurrency.lockutils [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] Acquiring lock "singleton_lock" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.678404] env[65553]: DEBUG oslo_concurrency.lockutils [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] Acquired lock "singleton_lock" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 523.678604] env[65553]: DEBUG oslo_concurrency.lockutils [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] Releasing lock "singleton_lock" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 523.678890] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] Full set of CONF: {{(pid=65553) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 523.679008] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ******************************************************************************** {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 523.679114] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] Configuration options gathered from: {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 523.679467] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 523.679637] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 523.679741] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ================================================================================ {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 523.679908] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] agent_down_time = 75 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.680058] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] allow_automatic_dhcp_failover = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.680194] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] allow_bulk = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.680332] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] api_extensions_path = {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.680463] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] api_paste_config = api-paste.ini {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.680596] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] auth_strategy = keystone {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.680698] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] backdoor_port = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.680808] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] backdoor_socket = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.680950] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] backlog = 4096 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.681114] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] base_mac = fa:16:3e:00:00:00 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.681266] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] bind_host = 0.0.0.0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.681403] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] bind_port = 9696 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.681534] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] client_socket_timeout = 900 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.681669] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] config_dir = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.681772] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.681904] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] config_source = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.682318] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] control_exchange = neutron {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.682318] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] core_plugin = ml2 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.682318] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] debug = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.682446] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] default_availability_zones = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.682628] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.682760] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] dhcp_agent_notification = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.682918] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] dhcp_agents_per_network = 1 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.683061] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] dhcp_lease_duration = 86400 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.683205] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] dhcp_load_type = networks {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.683337] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] dns_domain = openstacklocal {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.683470] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.683598] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] enable_default_route_bfd = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.683724] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] enable_default_route_ecmp = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.683849] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] enable_dvr = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.684012] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] enable_new_agents = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.684149] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.684275] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] enable_signals = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.684399] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] enable_traditional_dhcp = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.684521] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] external_dns_driver = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.684645] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] filter_validation = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.684780] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] global_physnet_mtu = 8950 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.684905] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] graceful_shutdown_timeout = 60 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.685090] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] host = cpu-1 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.685243] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] host_dvr_for_dhcp = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.685389] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] http_retries = 3 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.685526] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] instance_format = [instance: %(uuid)s] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.685658] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.685806] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ipam_driver = internal {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.685917] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ipv6_pd_enabled = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.686057] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] l3_ha = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.686193] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.686326] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] l3_ha_network_physical_name = {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.686458] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] l3_ha_network_type = {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.686591] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] log_color = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.686723] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] log_config_append = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.686854] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.686982] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] log_dir = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.687125] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] log_file = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.687225] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] log_options = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.687356] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] log_rotate_interval = 1 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.687488] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] log_rotate_interval_type = days {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.687619] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] log_rotation_type = none {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.687717] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.687814] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.687946] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.688086] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.688184] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.688312] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] max_dns_nameservers = 5 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.688439] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] max_header_line = 16384 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.688565] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] max_l3_agents_per_router = 3 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.688692] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] max_logfile_count = 30 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.688816] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] max_logfile_size_mb = 200 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.688941] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] max_subnet_host_routes = 20 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.689081] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] my_ip = 10.180.1.21 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.689218] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] my_ipv6 = ::1 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.689345] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] network_auto_schedule = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.689468] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] network_link_prefix = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.689599] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.689731] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] notify_nova_on_port_data_changes = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.689858] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] notify_nova_on_port_status_changes = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.689987] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] pagination_max_limit = -1 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.690126] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] publish_errors = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.690253] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] rate_limit_burst = 0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.690384] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] rate_limit_except_level = CRITICAL {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.690510] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] rate_limit_interval = 0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.690635] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] retry_until_window = 30 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.690773] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] router_distributed = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.690888] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] rpc_resources_processing_step = 20 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.691044] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] rpc_response_max_timeout = 600 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.691178] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] rpc_response_timeout = 60 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.691304] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] send_events_interval = 2 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.691446] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] service_plugins = ['router'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.691578] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] setproctitle = on {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.691700] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] shell_completion = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.691832] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] state_path = /opt/stack/data/neutron {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.691963] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] syslog_log_facility = LOG_USER {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.692101] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] tcp_keepidle = 600 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.692233] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] transport_url = **** {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.692358] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] use_journal = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.692479] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] use_json = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.692600] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] use_ssl = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.692722] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] use_stderr = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.692851] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] use_syslog = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.693009] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] vlan_qinq = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.693146] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] vlan_transparent = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.693271] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] watch_log_file = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.693396] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] wsgi_default_pool_size = 100 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.693522] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] wsgi_keep_alive = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.693655] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.693783] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] wsgi_server_debug = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.693928] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_concurrency.disable_process_locking = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.694076] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.694216] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.694345] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.694480] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.694612] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.694743] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.694886] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.connection_string = messaging:// {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.695032] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.enabled = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.695170] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.es_doc_type = notification {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.695327] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.es_scroll_size = 10000 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.695466] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.es_scroll_time = 2m {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.695595] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.filter_error_trace = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.695728] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.hmac_keys = **** {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.695860] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.sentinel_service_name = mymaster {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.695998] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.socket_timeout = 0.1 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.696144] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.trace_requests = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.696270] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler.trace_sqlalchemy = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.696411] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler_jaeger.process_tags = {} {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.696540] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler_jaeger.service_name_prefix = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.696670] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] profiler_otlp.service_name_prefix = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.696811] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.enforce_new_defaults = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.697090] env[65553]: WARNING oslo_config.cfg [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 523.697234] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.enforce_scope = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.697372] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.policy_default_rule = default {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.697516] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.697652] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.697787] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.697918] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.698057] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.698185] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.698313] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.698457] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_policy.remote_timeout = 60.0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.698592] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.698730] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] agent.extensions = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.698867] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.699012] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] service_providers.service_provider = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.699157] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.default_quota = -1 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.699293] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.699427] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.quota_floatingip = 50 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.699558] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.quota_network = 100 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.699686] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.quota_port = 500 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.699813] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.699941] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.quota_router = 10 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.700085] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.quota_security_group = 10 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.700215] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.700343] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.quota_subnet = 100 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.700471] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] QUOTAS.track_quota_usage = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.700612] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.700738] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep.group = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.700865] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep.helper_command = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.700991] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep.log_daemon_traceback = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.701138] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.701270] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep.thread_pool_size = 8 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.701397] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep.user = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.701531] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.701659] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_dhcp_release.group = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.701786] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_dhcp_release.helper_command = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.701917] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.702061] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.702195] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.702325] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_dhcp_release.user = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.702462] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.702588] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_ovs_vsctl.group = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.702713] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_ovs_vsctl.helper_command = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.702840] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.702998] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.703152] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.703281] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_ovs_vsctl.user = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.703418] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_namespace.capabilities = [21] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.703545] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_namespace.group = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.703670] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_namespace.helper_command = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.703799] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_namespace.log_daemon_traceback = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.703932] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.704075] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_namespace.thread_pool_size = 8 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.704205] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_namespace.user = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.704339] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_conntrack.capabilities = [12] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.704465] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_conntrack.group = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.704589] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_conntrack.helper_command = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.704717] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.704847] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.704977] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.705115] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_conntrack.user = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.705277] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_link.capabilities = [12, 21] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.705418] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_link.group = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.705547] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_link.helper_command = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.705675] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_link.log_daemon_traceback = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.705806] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.705936] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_link.thread_pool_size = 8 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.706074] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] privsep_link.user = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.706224] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.706368] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.706501] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.continue_on_failed_promotions = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.706630] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.dscp = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.706758] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.dscp_inherit = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.706894] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.force_mp_to_policy = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.707036] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.locking_coordinator_url = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.707162] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.log_agent_heartbeats = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.707293] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.logging_expire = 1 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.707427] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.707558] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.707721] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.polling_interval = 240 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.707821] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.707957] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.708112] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.report_interval = 30.0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.708250] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.708385] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.708518] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.708650] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.sync_skew = 60 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.708779] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.synchronization_queue_size = 20 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.708909] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT.use_helper_for_ns_read = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.709056] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] SECURITYGROUP.enable_ipset = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.709194] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] SECURITYGROUP.enable_security_group = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.709328] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.709467] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.709603] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] experimental.ipv6_pd_enabled = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.709750] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ml2.extension_drivers = ['port_security'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.709878] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ml2.external_network_type = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.710030] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.710173] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ml2.overlay_ip_version = 4 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.710309] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ml2.path_mtu = 8950 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.710445] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ml2.physical_network_mtus = {} {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.710589] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ml2.tenant_network_types = ['vlan'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.710724] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.710861] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ml2.type_drivers = ['vlan'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.711095] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT_CLI.neutron_port_id = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.711171] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.711302] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.711446] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.711584] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.711718] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.711854] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.711990] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.712140] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.712333] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.712475] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_login_password = **** {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.712616] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_login_port = 443 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.712749] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_login_user = admin {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.712891] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.713060] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.713201] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.713332] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.713469] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.713610] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.713746] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.713881] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.714020] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.714157] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.714296] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.714429] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.714564] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.714747] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.714888] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] vsphere.vsphere_login_password = VMware1! {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.715031] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.715166] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.715327] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.auth_section = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.715472] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.auth_type = password {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.715608] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.715735] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.certfile = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.716204] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.collect_timing = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.716204] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.endpoint_type = public {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.716204] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.insecure = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.716304] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.keyfile = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.716387] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.region_name = RegionOne {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.716510] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.split_loggers = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.716640] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] nova.timeout = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.716775] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.auth_section = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.716914] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.auth_type = password {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.717062] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.717190] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.certfile = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.717318] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.collect_timing = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.717464] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.endpoint_type = public {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.717575] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.insecure = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.717696] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.keyfile = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.717819] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.region_name = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.717944] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.split_loggers = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.718078] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] placement.timeout = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.718213] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.auth_section = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.718338] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.auth_type = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.718462] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.cafile = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.718587] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.certfile = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.718713] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.collect_timing = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.718836] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.connect_retries = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.718959] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.connect_retry_delay = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.719097] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.enable_notifications = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.719221] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.endpoint_override = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.719346] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.insecure = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.719468] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.interface = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.719590] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.keyfile = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.719716] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.max_version = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.719838] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.min_version = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.719960] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.region_name = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.720095] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.retriable_status_codes = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.720218] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.service_name = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.720337] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.service_type = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.720463] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.split_loggers = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.720583] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.status_code_retries = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.720705] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.status_code_retry_delay = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.720828] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.timeout = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.720974] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.valid_interfaces = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.721123] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ironic.version = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.721262] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] cli_script.dry_run = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.721397] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.721524] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.721654] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.721783] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.721910] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.722049] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.722179] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.722306] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.722434] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.722569] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.722692] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.722827] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.722989] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.723136] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.723271] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.723408] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.723537] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.723665] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.723798] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.723928] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.724068] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.724198] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.724325] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.724451] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.724578] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.724707] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.724832] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.724959] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.725096] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.725246] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.725388] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.ssl = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.725525] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.725657] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.725785] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.725916] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.726059] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.ssl_version = {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.726188] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.726323] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_notifications.driver = [] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.726455] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_notifications.retry = -1 {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.726599] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.726724] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] oslo_messaging_notifications.transport_url = **** {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.726824] env[65553]: DEBUG oslo_service.backend._eventlet.service [None req-13535576-9217-4f9e-9a84-5850c7ca55ed None None] ******************************************************************************** {{(pid=65553) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 523.727952] env[65553]: DEBUG neutron.agent.securitygroups_rpc [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Init firewall settings (driver=nsxv3) {{(pid=65553) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 523.729249] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65553) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 523.729491] env[65553]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] RPC agent_id: nsxm-l-01a.corp.local [ 523.731716] env[65553]: DEBUG dogpile.cache.region [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 523.731840] env[65553]: DEBUG dogpile.lock [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 523.731937] env[65553]: DEBUG dogpile.lock [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 523.732037] env[65553]: DEBUG dogpile.lock [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 523.732132] env[65553]: DEBUG dogpile.cache.region [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 523.732218] env[65553]: DEBUG dogpile.lock [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 523.732339] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 523.770959] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Session token - acquiring [ 523.772844] env[65553]: DEBUG networking_nsxv3.common.locking [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.773793] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.773793] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 523.773793] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 523.786414] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.069406] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 524.090644] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 524.090893] env[65553]: DEBUG dogpile.cache.region [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Cache value generated in 0.358 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 524.090958] env[65553]: DEBUG dogpile.lock [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 524.091036] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Activating Policy API Provider. [ 524.091242] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Looking for the default Infrastructure Rules. [ 524.157591] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Looking for the Default Layer3 Logged Drop Section. [ 524.174104] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 524.174566] env[65553]: DEBUG networking_nsxv3.common.locking [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.174729] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquiring lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.174830] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.175136] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired external semaphore "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.175474] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.690533] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.192685] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.694754] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Inventory metadata is going to be refreshed. [ 525.695132] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 526.501540] env[65553]: DEBUG networking_nsxv3.common.locking [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.501822] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.501957] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.502294] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.516029] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 526.517065] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.517776] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 526.537117] env[65553]: DEBUG networking_nsxv3.common.locking [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.537439] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.537606] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.537947] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.538327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.538562] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 526.538724] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.538870] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 526.559213] env[65553]: DEBUG networking_nsxv3.common.locking [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.559476] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.559628] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.559967] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.560246] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.560438] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 526.581906] env[65553]: DEBUG networking_nsxv3.common.locking [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.582212] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.582368] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.582701] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.582905] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.583143] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 526.603277] env[65553]: DEBUG networking_nsxv3.common.locking [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.603529] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquiring lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.603673] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.604019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired external semaphore "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.604228] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Releasing lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.604420] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 526.604667] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.604817] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 526.623490] env[65553]: DEBUG networking_nsxv3.common.locking [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.623763] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquiring lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.623948] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.624283] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired external semaphore "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.624451] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Releasing lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.624648] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 526.624869] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.625032] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 526.648014] env[65553]: DEBUG networking_nsxv3.common.locking [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.648211] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.648308] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.648599] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.648737] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.648887] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 526.648988] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.649111] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Inventory metadata have been refreshed. [ 526.649204] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Dryrun:True. Metadata refresh completed. [ 526.649316] env[65553]: DEBUG oslo_concurrency.lockutils [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Releasing lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.651254] env[65553]: INFO neutron.agent.agent_extensions_manager [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Loaded agent extensions: [] [ 526.652025] env[65553]: DEBUG neutron_lib.callbacks.manager [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65553) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 526.714365] env[65553]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] NSXv3 Agent Agent RPC Daemon Started! [ 526.714713] env[65553]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] NSXv3 Agent Agent loop - iteration:0 started [ 526.714713] env[65553]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] NSXv3 Agent Agent out of sync with plugin! [ 531.652924] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 531.652924] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 536.654072] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 536.654355] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 541.655834] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 541.656246] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 541.944183] env[65553]: INFO networking_nsxv3.common.synchronization [None req-35f90311-9eee-410a-b916-1992e0a8eafe demo admin] Enqueued Resource ID: b30ab92b-79af-493b-a79a-125f8a114665 with Priority: HIGHEST for action security_group_rules [ 541.944723] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b30ab92b-79af-493b-a79a-125f8a114665 with Priority: HIGHEST for action security_group_rules [ 541.945042] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b30ab92b-79af-493b-a79a-125f8a114665 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.945182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b30ab92b-79af-493b-a79a-125f8a114665" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.945249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b30ab92b-79af-493b-a79a-125f8a114665" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.945597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b30ab92b-79af-493b-a79a-125f8a114665" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.945682] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b30ab92b-79af-493b-a79a-125f8a114665',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.468427] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.468698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.468698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.468909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.468978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.469082] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b30ab92b-79af-493b-a79a-125f8a114665 already deleted. [ 542.469142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b30ab92b-79af-493b-a79a-125f8a114665" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.946372] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.946726] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.947152] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.947615] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 556.948453] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.948816] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.949726] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.950296] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.951147] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.951441] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.952807] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.952807] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.520018] env[65553]: INFO networking_nsxv3.common.synchronization [None req-87bf179a-21dc-4957-8ff7-896afa3ff680 None None] Enqueued Resource ID: 60e0ec42-f305-4b3e-b795-b8ca2ba6b576 with Priority: HIGHEST for action port [ 573.520576] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60e0ec42-f305-4b3e-b795-b8ca2ba6b576 with Priority: HIGHEST for action port [ 573.520821] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-60e0ec42-f305-4b3e-b795-b8ca2ba6b576 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.520946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60e0ec42-f305-4b3e-b795-b8ca2ba6b576" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.521323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60e0ec42-f305-4b3e-b795-b8ca2ba6b576" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.521800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60e0ec42-f305-4b3e-b795-b8ca2ba6b576" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.521965] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60e0ec42-f305-4b3e-b795-b8ca2ba6b576',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.652343] env[65553]: INFO networking_nsxv3.common.synchronization [None req-73c327a8-713f-48ab-b7fc-410cf546aaa1 None None] Enqueued Resource ID: d738d4e9-8bff-41ad-9ad3-19f648e9aa72 with Priority: HIGHEST for action port [ 573.656326] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d738d4e9-8bff-41ad-9ad3-19f648e9aa72 with Priority: HIGHEST for action port [ 573.656326] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d738d4e9-8bff-41ad-9ad3-19f648e9aa72 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.656326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d738d4e9-8bff-41ad-9ad3-19f648e9aa72" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.656326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d738d4e9-8bff-41ad-9ad3-19f648e9aa72" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.656326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d738d4e9-8bff-41ad-9ad3-19f648e9aa72" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.656326] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d738d4e9-8bff-41ad-9ad3-19f648e9aa72',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.025561] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60e0ec42-f305-4b3e-b795-b8ca2ba6b576 [ 574.025561] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.025561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.025561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.025792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.025895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.026554] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60e0ec42-f305-4b3e-b795-b8ca2ba6b576 already deleted. [ 574.026554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60e0ec42-f305-4b3e-b795-b8ca2ba6b576" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.159416] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d738d4e9-8bff-41ad-9ad3-19f648e9aa72 [ 574.159659] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.159797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.159866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.160168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.160277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.160374] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d738d4e9-8bff-41ad-9ad3-19f648e9aa72 already deleted. [ 574.160465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d738d4e9-8bff-41ad-9ad3-19f648e9aa72" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.317769] env[65553]: INFO networking_nsxv3.common.synchronization [None req-8322bc16-8627-4d06-8c82-ef63c97b32a8 None None] Enqueued Resource ID: 60b19f89-b72d-43f9-bf8b-6cbd0853e622 with Priority: HIGHEST for action port [ 574.318628] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b19f89-b72d-43f9-bf8b-6cbd0853e622 with Priority: HIGHEST for action port [ 574.319287] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-60b19f89-b72d-43f9-bf8b-6cbd0853e622 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.320524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60b19f89-b72d-43f9-bf8b-6cbd0853e622" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.320524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60b19f89-b72d-43f9-bf8b-6cbd0853e622" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.322164] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60b19f89-b72d-43f9-bf8b-6cbd0853e622" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.322164] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60b19f89-b72d-43f9-bf8b-6cbd0853e622',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.422256] env[65553]: INFO networking_nsxv3.common.synchronization [None req-b803ce48-3585-4411-828a-2b071ad52920 None None] Enqueued Resource ID: 2738893a-9855-40a6-ae27-d1a1e2e23ed4 with Priority: HIGHEST for action port [ 574.422256] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2738893a-9855-40a6-ae27-d1a1e2e23ed4 with Priority: HIGHEST for action port [ 574.422256] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2738893a-9855-40a6-ae27-d1a1e2e23ed4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.422256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2738893a-9855-40a6-ae27-d1a1e2e23ed4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.422256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2738893a-9855-40a6-ae27-d1a1e2e23ed4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.422766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2738893a-9855-40a6-ae27-d1a1e2e23ed4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.422958] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2738893a-9855-40a6-ae27-d1a1e2e23ed4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.825121] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60b19f89-b72d-43f9-bf8b-6cbd0853e622 [ 574.825121] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.825121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.825121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.825121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.825121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.825121] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60b19f89-b72d-43f9-bf8b-6cbd0853e622 already deleted. [ 574.825121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60b19f89-b72d-43f9-bf8b-6cbd0853e622" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.928038] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2738893a-9855-40a6-ae27-d1a1e2e23ed4 [ 574.928313] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.928313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.928313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.929846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.929960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.930103] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2738893a-9855-40a6-ae27-d1a1e2e23ed4 already deleted. [ 574.930194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2738893a-9855-40a6-ae27-d1a1e2e23ed4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.847601] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f4f1dd4e-d220-4daf-9100-e3773fed1f50 None None] Enqueued Resource ID: 15a661b5-9275-4eb9-9fce-51738974cd71 with Priority: HIGHEST for action port [ 575.847819] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a661b5-9275-4eb9-9fce-51738974cd71 with Priority: HIGHEST for action port [ 575.848403] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-15a661b5-9275-4eb9-9fce-51738974cd71 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.848539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15a661b5-9275-4eb9-9fce-51738974cd71" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.848610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15a661b5-9275-4eb9-9fce-51738974cd71" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.849041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15a661b5-9275-4eb9-9fce-51738974cd71" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.849041] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15a661b5-9275-4eb9-9fce-51738974cd71',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.358798] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15a661b5-9275-4eb9-9fce-51738974cd71 [ 576.359232] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.360825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.360825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.360825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.360825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.360825] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15a661b5-9275-4eb9-9fce-51738974cd71 already deleted. [ 576.360825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15a661b5-9275-4eb9-9fce-51738974cd71" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.888463] env[65553]: INFO networking_nsxv3.common.synchronization [None req-57836f80-2150-4d8c-8490-7edf0813d95b None None] Enqueued Resource ID: 97ab82e2-68db-4391-b4c5-17f88e90b54d with Priority: HIGHEST for action port [ 576.889470] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97ab82e2-68db-4391-b4c5-17f88e90b54d with Priority: HIGHEST for action port [ 576.889970] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-97ab82e2-68db-4391-b4c5-17f88e90b54d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.890082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97ab82e2-68db-4391-b4c5-17f88e90b54d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.890171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97ab82e2-68db-4391-b4c5-17f88e90b54d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.890513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97ab82e2-68db-4391-b4c5-17f88e90b54d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.890599] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97ab82e2-68db-4391-b4c5-17f88e90b54d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.394756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97ab82e2-68db-4391-b4c5-17f88e90b54d [ 577.394978] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.395139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.395206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.396660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.396660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.396660] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97ab82e2-68db-4391-b4c5-17f88e90b54d already deleted. [ 577.396660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97ab82e2-68db-4391-b4c5-17f88e90b54d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.049678] env[65553]: INFO networking_nsxv3.common.synchronization [None req-049c50f0-c71c-4f4a-8f7b-b33091de8785 None None] Enqueued Resource ID: 610a81e3-3e09-478a-877b-a15df13841fa with Priority: HIGHEST for action port [ 578.049960] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 610a81e3-3e09-478a-877b-a15df13841fa with Priority: HIGHEST for action port [ 578.050842] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-610a81e3-3e09-478a-877b-a15df13841fa taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.050943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-610a81e3-3e09-478a-877b-a15df13841fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.051026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-610a81e3-3e09-478a-877b-a15df13841fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.053584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-610a81e3-3e09-478a-877b-a15df13841fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.053584] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('610a81e3-3e09-478a-877b-a15df13841fa',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.459857] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f5f8944d-9f1d-4491-90dd-c8cc7e5388d6 None None] Enqueued Resource ID: 4d3d6ef8-8486-437c-b05c-92a089006884 with Priority: HIGHEST for action port [ 578.459857] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3d6ef8-8486-437c-b05c-92a089006884 with Priority: HIGHEST for action port [ 578.459857] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d3d6ef8-8486-437c-b05c-92a089006884 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.459857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d3d6ef8-8486-437c-b05c-92a089006884" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.459857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d3d6ef8-8486-437c-b05c-92a089006884" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.459857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d3d6ef8-8486-437c-b05c-92a089006884" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.459857] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d3d6ef8-8486-437c-b05c-92a089006884',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.555151] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 610a81e3-3e09-478a-877b-a15df13841fa [ 578.555408] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.555619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.555755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.556070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.556162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.556266] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:610a81e3-3e09-478a-877b-a15df13841fa already deleted. [ 578.556363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-610a81e3-3e09-478a-877b-a15df13841fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.964221] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d3d6ef8-8486-437c-b05c-92a089006884 [ 578.964221] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.964221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.965227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.965227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.965227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.965227] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d3d6ef8-8486-437c-b05c-92a089006884 already deleted. [ 578.965227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d3d6ef8-8486-437c-b05c-92a089006884" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.055348] env[65553]: INFO networking_nsxv3.common.synchronization [None req-0e2bbe60-2d79-413a-8f38-e757ec2f3cd1 None None] Enqueued Resource ID: 41b09cf8-7b99-4096-816f-9b7102ab52de with Priority: HIGHEST for action port [ 579.055629] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41b09cf8-7b99-4096-816f-9b7102ab52de with Priority: HIGHEST for action port [ 579.056194] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-41b09cf8-7b99-4096-816f-9b7102ab52de taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.056319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41b09cf8-7b99-4096-816f-9b7102ab52de" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.056386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41b09cf8-7b99-4096-816f-9b7102ab52de" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.056632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41b09cf8-7b99-4096-816f-9b7102ab52de" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.056713] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41b09cf8-7b99-4096-816f-9b7102ab52de',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.558990] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41b09cf8-7b99-4096-816f-9b7102ab52de [ 579.559231] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.559337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.559406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.559622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.559732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.559800] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41b09cf8-7b99-4096-816f-9b7102ab52de already deleted. [ 579.559881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41b09cf8-7b99-4096-816f-9b7102ab52de" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.638085] env[65553]: INFO networking_nsxv3.common.synchronization [None req-a17ab7cf-335d-4d34-8af9-b9bca81edcbb None None] Enqueued Resource ID: d9849f2f-80f6-4c03-af3b-95ad81fe8938 with Priority: HIGHEST for action port [ 580.638711] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9849f2f-80f6-4c03-af3b-95ad81fe8938 with Priority: HIGHEST for action port [ 580.638945] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9849f2f-80f6-4c03-af3b-95ad81fe8938 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.639047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9849f2f-80f6-4c03-af3b-95ad81fe8938" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.639222] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9849f2f-80f6-4c03-af3b-95ad81fe8938" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.639341] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9849f2f-80f6-4c03-af3b-95ad81fe8938" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.639425] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9849f2f-80f6-4c03-af3b-95ad81fe8938',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.698482] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f8e82c3d-942a-4352-8da0-f4206a375045 None None] Enqueued Resource ID: c55a1143-b299-43d3-abda-32f015524d05 with Priority: HIGHEST for action port [ 580.698729] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c55a1143-b299-43d3-abda-32f015524d05 with Priority: HIGHEST for action port [ 580.699662] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c55a1143-b299-43d3-abda-32f015524d05 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.699662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c55a1143-b299-43d3-abda-32f015524d05" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.699811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c55a1143-b299-43d3-abda-32f015524d05" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.700877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c55a1143-b299-43d3-abda-32f015524d05" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.701017] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c55a1143-b299-43d3-abda-32f015524d05',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.142189] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9849f2f-80f6-4c03-af3b-95ad81fe8938 [ 581.142490] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.143120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.143120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.143120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.143120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.143362] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9849f2f-80f6-4c03-af3b-95ad81fe8938 already deleted. [ 581.143362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9849f2f-80f6-4c03-af3b-95ad81fe8938" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.203281] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c55a1143-b299-43d3-abda-32f015524d05 [ 581.203572] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.203718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.203793] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.204034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.204388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.204388] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c55a1143-b299-43d3-abda-32f015524d05 already deleted. [ 581.204388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c55a1143-b299-43d3-abda-32f015524d05" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.654705] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.655037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.655037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.655192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.655425] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.086066] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d4ed1b06-d73a-4ecc-ac67-e18c1b8ea51c None None] Enqueued Resource ID: cfaf4443-a6b3-4f4a-9ad4-14fd55834677 with Priority: HIGHEST for action port [ 582.086066] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfaf4443-a6b3-4f4a-9ad4-14fd55834677 with Priority: HIGHEST for action port [ 582.086479] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfaf4443-a6b3-4f4a-9ad4-14fd55834677 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.086604] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfaf4443-a6b3-4f4a-9ad4-14fd55834677" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.086669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfaf4443-a6b3-4f4a-9ad4-14fd55834677" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.086908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfaf4443-a6b3-4f4a-9ad4-14fd55834677" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.087797] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfaf4443-a6b3-4f4a-9ad4-14fd55834677',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.159538] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.547065] env[65553]: INFO networking_nsxv3.common.synchronization [None req-2bef8228-12ba-4a5a-b400-efb14d21c671 None None] Enqueued Resource ID: 9f70120f-a46e-41b7-ad91-ef8e82545208 with Priority: HIGHEST for action port [ 582.549188] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f70120f-a46e-41b7-ad91-ef8e82545208 with Priority: HIGHEST for action port [ 582.549188] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f70120f-a46e-41b7-ad91-ef8e82545208 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.549188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f70120f-a46e-41b7-ad91-ef8e82545208" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.549188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f70120f-a46e-41b7-ad91-ef8e82545208" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.549188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f70120f-a46e-41b7-ad91-ef8e82545208" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.549188] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f70120f-a46e-41b7-ad91-ef8e82545208',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.591031] env[65553]: INFO networking_nsxv3.common.synchronization [req-2c36c047-c041-429e-b950-5a23c26f988a req-360b7e54-a6c9-4324-9ed6-cb96f0a74288 tempest-ServerDiagnosticsTest-1424423745 tempest-ServerDiagnosticsTest-1424423745-project-member] Enqueued Resource ID: 84881d5c-05c0-4bde-84e9-437b2da92669 with Priority: HIGHEST for action security_group_members [ 582.591165] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfaf4443-a6b3-4f4a-9ad4-14fd55834677 [ 582.592033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.592033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.592033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.592033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.592033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.592033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfaf4443-a6b3-4f4a-9ad4-14fd55834677 already deleted. [ 582.592883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfaf4443-a6b3-4f4a-9ad4-14fd55834677" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.593531] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84881d5c-05c0-4bde-84e9-437b2da92669 with Priority: HIGHEST for action security_group_members [ 582.594086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-84881d5c-05c0-4bde-84e9-437b2da92669 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.594311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.595074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.595074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.595074] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.595074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.595074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.596507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.596608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.596974] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84881d5c-05c0-4bde-84e9-437b2da92669',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.661518] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.051374] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f70120f-a46e-41b7-ad91-ef8e82545208 [ 583.052337] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.052337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.052337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.052337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.052337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.052337] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f70120f-a46e-41b7-ad91-ef8e82545208 already deleted. [ 583.052656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f70120f-a46e-41b7-ad91-ef8e82545208" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.099255] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.100116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.100253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.100580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.100727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.101047] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.101234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.101325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.102033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.102033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.102033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84881d5c-05c0-4bde-84e9-437b2da92669 already deleted. [ 583.102033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.164415] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 583.164622] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 583.547209] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.547408] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.547528] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.549824] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.553019] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.553019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.553019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.553019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.553019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.553019] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.553019] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 583.553019] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 583.553019] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 583.553019] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.553019] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 583.553019] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 583.581676] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 583.581676] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 583.581676] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 583.581891] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.583059] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-721bf82c-bd3c-4fe9-b05a-8d2dda3e9343 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.583276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-721bf82c-bd3c-4fe9-b05a-8d2dda3e9343" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.583398] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-721bf82c-bd3c-4fe9-b05a-8d2dda3e9343" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.584619] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-721bf82c-bd3c-4fe9-b05a-8d2dda3e9343" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.584756] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('721bf82c-bd3c-4fe9-b05a-8d2dda3e9343',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.914095] env[65553]: INFO networking_nsxv3.common.synchronization [None req-e6b9982d-66c9-4422-b05f-303a4affab46 None None] Enqueued Resource ID: 8fd5275f-b3a4-4db6-97c7-8d8e89253048 with Priority: HIGHEST for action port [ 583.914710] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fd5275f-b3a4-4db6-97c7-8d8e89253048 with Priority: HIGHEST for action port [ 583.915040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fd5275f-b3a4-4db6-97c7-8d8e89253048 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.915169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fd5275f-b3a4-4db6-97c7-8d8e89253048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.915266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fd5275f-b3a4-4db6-97c7-8d8e89253048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.915522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fd5275f-b3a4-4db6-97c7-8d8e89253048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.915604] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fd5275f-b3a4-4db6-97c7-8d8e89253048',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.928912] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.929090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.929133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.929328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.942115] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 583.942999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.943774] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 583.964380] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.964587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.964587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.964807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.964894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.965012] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 583.965087] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 583.965160] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 583.987827] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.988021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.988065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.988260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.988402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.988806] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 584.009742] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.009890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.009960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.010421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.010421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.010543] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 584.031086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.031901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.031901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.032051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.032188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.032900] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 584.032900] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.032900] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 584.052447] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.052637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.052670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.053281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.053281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.053281] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 584.053281] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.053281] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 584.076719] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.076959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.076959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.077657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.077744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.078675] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 584.078873] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 584.078873] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 584.079074] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 584.079200] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 584.079292] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 584.079376] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 584.079703] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 584.079880] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 584.079880] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 584.087541] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.087751] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.087871] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.088147] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.088294] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.088485] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 721bf82c-bd3c-4fe9-b05a-8d2dda3e9343 not found, creating... [ 584.088910] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.088910] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.089073] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.089379] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.089516] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.089867] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.090034] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.090147] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.090352] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.090480] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.090611] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 721bf82c-bd3c-4fe9-b05a-8d2dda3e9343 is going to be created. [ 584.101530] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.101685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.101736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.101964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.102089] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.102203] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 584.111685] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.111895] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.112026] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.112293] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.112509] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.112715] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-721bf82c-bd3c-4fe9-b05a-8d2dda3e9343" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.124355] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.124511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.124511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.124828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.124956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.139785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.180348] env[65553]: INFO networking_nsxv3.common.synchronization [None req-7962f4f1-0955-489c-84e3-8fc5a8a8e56f None None] Enqueued Resource ID: e073113a-d4b1-4396-ac50-6708b886fb4e with Priority: HIGHEST for action port [ 584.180866] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e073113a-d4b1-4396-ac50-6708b886fb4e with Priority: HIGHEST for action port [ 584.181178] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e073113a-d4b1-4396-ac50-6708b886fb4e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.181298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e073113a-d4b1-4396-ac50-6708b886fb4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.181366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e073113a-d4b1-4396-ac50-6708b886fb4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.181641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e073113a-d4b1-4396-ac50-6708b886fb4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.181739] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e073113a-d4b1-4396-ac50-6708b886fb4e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.417428] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fd5275f-b3a4-4db6-97c7-8d8e89253048 [ 584.417658] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.417796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.417866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.418121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.418218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.418314] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fd5275f-b3a4-4db6-97c7-8d8e89253048 already deleted. [ 584.418398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fd5275f-b3a4-4db6-97c7-8d8e89253048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.684437] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e073113a-d4b1-4396-ac50-6708b886fb4e [ 584.684694] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.684797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.684834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.685057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.685212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.685242] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e073113a-d4b1-4396-ac50-6708b886fb4e already deleted. [ 584.685323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e073113a-d4b1-4396-ac50-6708b886fb4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.320843] env[65553]: INFO networking_nsxv3.common.synchronization [req-2c36c047-c041-429e-b950-5a23c26f988a req-2a515c4a-493e-484d-a348-0dd3660a12b6 service nova] Enqueued Resource ID: 84881d5c-05c0-4bde-84e9-437b2da92669 with Priority: HIGHEST for action security_group_rules [ 585.321103] env[65553]: INFO networking_nsxv3.common.synchronization [req-2c36c047-c041-429e-b950-5a23c26f988a req-2a515c4a-493e-484d-a348-0dd3660a12b6 service nova] Enqueued Resource ID: 84881d5c-05c0-4bde-84e9-437b2da92669 with Priority: HIGHEST for action security_group_members [ 585.321144] env[65553]: INFO networking_nsxv3.common.synchronization [req-2c36c047-c041-429e-b950-5a23c26f988a req-2a515c4a-493e-484d-a348-0dd3660a12b6 service nova] Enqueued Resource ID: 721bf82c-bd3c-4fe9-b05a-8d2dda3e9343 with Priority: HIGHEST for action port [ 585.321380] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84881d5c-05c0-4bde-84e9-437b2da92669 with Priority: HIGHEST for action security_group_rules [ 585.321508] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84881d5c-05c0-4bde-84e9-437b2da92669 with Priority: HIGHEST for action security_group_members [ 585.321646] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 721bf82c-bd3c-4fe9-b05a-8d2dda3e9343 with Priority: HIGHEST for action port [ 585.323151] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84881d5c-05c0-4bde-84e9-437b2da92669 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.323215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.323245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.323500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.323643] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84881d5c-05c0-4bde-84e9-437b2da92669',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.324607] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-84881d5c-05c0-4bde-84e9-437b2da92669 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.324803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.324875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.325068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.325225] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.325364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.325433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.325578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.325666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.325754] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84881d5c-05c0-4bde-84e9-437b2da92669',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.328571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-721bf82c-bd3c-4fe9-b05a-8d2dda3e9343 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.328706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-721bf82c-bd3c-4fe9-b05a-8d2dda3e9343" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.328794] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-721bf82c-bd3c-4fe9-b05a-8d2dda3e9343" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.328988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-721bf82c-bd3c-4fe9-b05a-8d2dda3e9343" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.329098] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('721bf82c-bd3c-4fe9-b05a-8d2dda3e9343',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.836705] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-84881d5c-05c0-4bde-84e9-437b2da92669 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.837213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.848824] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 721bf82c-bd3c-4fe9-b05a-8d2dda3e9343 with status ACTIVE [ 585.852289] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.852289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.852289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.852289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.852289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.853392] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.853392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.853392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.853392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.853392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.853392] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.853392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.853392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.853392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.853392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.853836] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 721bf82c-bd3c-4fe9-b05a-8d2dda3e9343 is going to be updated. [ 585.855079] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84881d5c-05c0-4bde-84e9-437b2da92669',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.877669] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.877811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.877896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.878118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.878261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.878414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-721bf82c-bd3c-4fe9-b05a-8d2dda3e9343" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.011056] env[65553]: INFO networking_nsxv3.common.synchronization [req-92b8a37f-d832-4132-b227-526bce6ec163 req-a07a097d-5a0b-447b-bc60-bdabbe64abb6 tempest-DeleteServersAdminTestJSON-651714207 tempest-DeleteServersAdminTestJSON-651714207-project-member] Enqueued Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 586.011601] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 586.011939] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.015157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.015246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.015485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.016169] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.016169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.016169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.016359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.016498] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.016559] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.358323] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84881d5c-05c0-4bde-84e9-437b2da92669',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.520127] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.520753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.520753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.520753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.520753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.521000] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.521000] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.521000] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.521592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.521592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.521592] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 already deleted. [ 586.521592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.550578] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.550669] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.550733] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.550987] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.551291] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.551393] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.551502] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.551956] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.552205] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.552523] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.552767] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.552939] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.555301] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.555301] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.555301] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.555301] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.575499] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.575877] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 586.575877] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.576010] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.576297] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-58a65daa-5e7d-445e-9c3c-87f989878b12 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.576470] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-58a65daa-5e7d-445e-9c3c-87f989878b12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.576585] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-58a65daa-5e7d-445e-9c3c-87f989878b12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.577036] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-58a65daa-5e7d-445e-9c3c-87f989878b12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.577103] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58a65daa-5e7d-445e-9c3c-87f989878b12',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.755176] env[65553]: INFO networking_nsxv3.common.synchronization [None req-dc772cc1-2d2f-4c46-a494-b193ac2adfa0 None None] Enqueued Resource ID: d6c53987-98b5-4b04-b69d-ac650efca922 with Priority: HIGHEST for action port [ 586.755432] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c53987-98b5-4b04-b69d-ac650efca922 with Priority: HIGHEST for action port [ 586.755988] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6c53987-98b5-4b04-b69d-ac650efca922 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.756126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6c53987-98b5-4b04-b69d-ac650efca922" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.756195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6c53987-98b5-4b04-b69d-ac650efca922" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.756441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6c53987-98b5-4b04-b69d-ac650efca922" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.756521] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6c53987-98b5-4b04-b69d-ac650efca922',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.796248] env[65553]: INFO networking_nsxv3.common.synchronization [None req-6713db36-21f9-4924-a073-235d192529ae None None] Enqueued Resource ID: c11d95c7-e0ec-470d-b50d-d753c92c4b21 with Priority: HIGHEST for action port [ 586.796729] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c11d95c7-e0ec-470d-b50d-d753c92c4b21 with Priority: HIGHEST for action port [ 586.797029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c11d95c7-e0ec-470d-b50d-d753c92c4b21 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.797153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c11d95c7-e0ec-470d-b50d-d753c92c4b21" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.797222] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c11d95c7-e0ec-470d-b50d-d753c92c4b21" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.797459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c11d95c7-e0ec-470d-b50d-d753c92c4b21" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.797538] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c11d95c7-e0ec-470d-b50d-d753c92c4b21',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.862410] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.863036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.863036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.863036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.863036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.863036] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84881d5c-05c0-4bde-84e9-437b2da92669 is going to be created. [ 586.894786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.895693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.895693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.895693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.895822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.906806] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84881d5c-05c0-4bde-84e9-437b2da92669 in Status: UNINITIALIZED for 2s [ 587.079956] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.080200] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.080324] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.080603] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.080779] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.080928] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 58a65daa-5e7d-445e-9c3c-87f989878b12 not found, creating... [ 587.081198] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.081957] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.081957] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.081957] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.081957] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.082149] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.082207] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.082318] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.082515] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.082643] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.082775] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 58a65daa-5e7d-445e-9c3c-87f989878b12 is going to be created. [ 587.102956] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.103179] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.103301] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.103594] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.103829] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.104059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-58a65daa-5e7d-445e-9c3c-87f989878b12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.259887] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6c53987-98b5-4b04-b69d-ac650efca922 [ 587.259887] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.259887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.259887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.259887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.259887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.260231] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6c53987-98b5-4b04-b69d-ac650efca922 already deleted. [ 587.260231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6c53987-98b5-4b04-b69d-ac650efca922" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.299040] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c11d95c7-e0ec-470d-b50d-d753c92c4b21 [ 587.299601] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.299601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.299601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.299840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.299935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.300197] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c11d95c7-e0ec-470d-b50d-d753c92c4b21 already deleted. [ 587.300291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c11d95c7-e0ec-470d-b50d-d753c92c4b21" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.696467] env[65553]: INFO networking_nsxv3.common.synchronization [None req-56c52142-b375-4e47-b824-8b593a05bad7 None None] Enqueued Resource ID: 001957bd-5c21-469b-8e41-34fd3c4ef998 with Priority: HIGHEST for action port [ 587.696467] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001957bd-5c21-469b-8e41-34fd3c4ef998 with Priority: HIGHEST for action port [ 587.696467] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-001957bd-5c21-469b-8e41-34fd3c4ef998 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.696467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-001957bd-5c21-469b-8e41-34fd3c4ef998" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.696467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-001957bd-5c21-469b-8e41-34fd3c4ef998" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.696918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-001957bd-5c21-469b-8e41-34fd3c4ef998" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.696918] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('001957bd-5c21-469b-8e41-34fd3c4ef998',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.800539] env[65553]: INFO networking_nsxv3.common.synchronization [req-92b8a37f-d832-4132-b227-526bce6ec163 req-94c9a6a5-fd67-4f22-b657-4683715ec9f4 service nova] Enqueued Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_rules [ 587.800709] env[65553]: INFO networking_nsxv3.common.synchronization [req-92b8a37f-d832-4132-b227-526bce6ec163 req-94c9a6a5-fd67-4f22-b657-4683715ec9f4 service nova] Enqueued Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 587.801968] env[65553]: INFO networking_nsxv3.common.synchronization [req-92b8a37f-d832-4132-b227-526bce6ec163 req-94c9a6a5-fd67-4f22-b657-4683715ec9f4 service nova] Enqueued Resource ID: 58a65daa-5e7d-445e-9c3c-87f989878b12 with Priority: HIGHEST for action port [ 587.801968] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_rules [ 587.801968] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 587.801968] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a65daa-5e7d-445e-9c3c-87f989878b12 with Priority: HIGHEST for action port [ 587.801968] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.801968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.802416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.802416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.802513] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.803860] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.804169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.804169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.805112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.805112] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.805112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.805112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.805112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.805112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.805112] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.806630] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-58a65daa-5e7d-445e-9c3c-87f989878b12 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.806630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58a65daa-5e7d-445e-9c3c-87f989878b12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.806630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58a65daa-5e7d-445e-9c3c-87f989878b12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.806926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58a65daa-5e7d-445e-9c3c-87f989878b12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.806926] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58a65daa-5e7d-445e-9c3c-87f989878b12',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.200764] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 001957bd-5c21-469b-8e41-34fd3c4ef998 [ 588.201313] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.201313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.201313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.201554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.201554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.201614] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:001957bd-5c21-469b-8e41-34fd3c4ef998 already deleted. [ 588.201663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-001957bd-5c21-469b-8e41-34fd3c4ef998" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.304545] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.304767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.307130] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.310075] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58a65daa-5e7d-445e-9c3c-87f989878b12 with status ACTIVE [ 588.310292] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.310421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.310487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.310705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.310798] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.311063] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.311063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.311176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.311253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.311591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.311591] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.311591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.311744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.311806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.311876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.311958] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58a65daa-5e7d-445e-9c3c-87f989878b12 is going to be updated. [ 588.340284] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.340432] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.340476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.341035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.341035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.341035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58a65daa-5e7d-445e-9c3c-87f989878b12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.385854] env[65553]: INFO networking_nsxv3.common.synchronization [req-d949b1eb-c784-430b-961d-d06ad6568c20 req-229dec98-7b2b-42cd-a472-477ae9333c20 tempest-ImagesTestJSON-1118693169 tempest-ImagesTestJSON-1118693169-project-member] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 588.387076] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 588.387076] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.387076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.387076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.387317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.387481] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.387576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.387640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.387797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.387881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.387972] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.802040] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f16998a2-3c46-4836-9cda-0a0bf246b324 None None] Enqueued Resource ID: ab255c24-ec75-44f0-8b2a-a635d2575d8f with Priority: HIGHEST for action port [ 588.802599] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab255c24-ec75-44f0-8b2a-a635d2575d8f with Priority: HIGHEST for action port [ 588.802910] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab255c24-ec75-44f0-8b2a-a635d2575d8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.803116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab255c24-ec75-44f0-8b2a-a635d2575d8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.803168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab255c24-ec75-44f0-8b2a-a635d2575d8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.803478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab255c24-ec75-44f0-8b2a-a635d2575d8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.803561] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab255c24-ec75-44f0-8b2a-a635d2575d8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.810986] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.889678] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.889836] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.889945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.890149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.891105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.891105] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.891105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.891105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.891105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.891105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.891105] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 already deleted. [ 588.891105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.918570] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84881d5c-05c0-4bde-84e9-437b2da92669 in Status: SUCCESS [ 588.918975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.919153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.919576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.919576] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.919738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.919738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.919942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.920106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.920193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.920661] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84881d5c-05c0-4bde-84e9-437b2da92669',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.089287] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.089287] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.089287] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.089287] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.089466] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.089620] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.089731] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.089944] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.090129] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.092141] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.092141] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.092141] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.092141] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.092141] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.092141] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.092141] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.112650] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.112838] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.113039] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.113116] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.113448] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-209ae543-1ee7-40af-a62b-06fa66275317 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.113775] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-209ae543-1ee7-40af-a62b-06fa66275317" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.113839] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-209ae543-1ee7-40af-a62b-06fa66275317" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.114207] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-209ae543-1ee7-40af-a62b-06fa66275317" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.115172] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('209ae543-1ee7-40af-a62b-06fa66275317',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.306996] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab255c24-ec75-44f0-8b2a-a635d2575d8f [ 589.306996] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.306996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.306996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.307291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.307342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.307437] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab255c24-ec75-44f0-8b2a-a635d2575d8f already deleted. [ 589.307521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab255c24-ec75-44f0-8b2a-a635d2575d8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.311086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.311240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.311284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.311507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.311607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.311855] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 is going to be created. [ 589.337840] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.337996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.338075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.338291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.338449] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.348582] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: UNINITIALIZED for 2s [ 589.423804] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-84881d5c-05c0-4bde-84e9-437b2da92669 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.423804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.423804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.424045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.424190] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.424289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.424351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.424530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.424622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.424684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.424846] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-84881d5c-05c0-4bde-84e9-437b2da92669 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.424918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.424953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.425090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.425227] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.425652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.425652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.425652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.425652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.425652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.425836] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84881d5c-05c0-4bde-84e9-437b2da92669',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.617152] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.617317] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.617435] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.617713] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.617858] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.618019] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 209ae543-1ee7-40af-a62b-06fa66275317 not found, creating... [ 589.618276] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.618426] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.618527] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.618752] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.618883] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.619178] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.619329] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.619439] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.619637] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.619807] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.619888] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 209ae543-1ee7-40af-a62b-06fa66275317 is going to be created. [ 589.646651] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.646651] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.646651] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.646651] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.646651] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.646651] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-209ae543-1ee7-40af-a62b-06fa66275317" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.716228] env[65553]: INFO networking_nsxv3.common.synchronization [None req-b94d8f32-0e8c-4ae9-ab54-b59e7d615594 None None] Enqueued Resource ID: 680ecc24-ba28-4a80-8dbc-c645fd3d33ab with Priority: HIGHEST for action port [ 589.716739] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 680ecc24-ba28-4a80-8dbc-c645fd3d33ab with Priority: HIGHEST for action port [ 589.717092] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-680ecc24-ba28-4a80-8dbc-c645fd3d33ab taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.717306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-680ecc24-ba28-4a80-8dbc-c645fd3d33ab" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.717390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-680ecc24-ba28-4a80-8dbc-c645fd3d33ab" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.717677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-680ecc24-ba28-4a80-8dbc-c645fd3d33ab" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.717788] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('680ecc24-ba28-4a80-8dbc-c645fd3d33ab',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.929352] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84881d5c-05c0-4bde-84e9-437b2da92669: rpc.has_security_group_logging(os_id): False [ 589.949033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.949191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.949261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.949479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.949589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.949890] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.950093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.950669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.950918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.951070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.951303] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.951471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.951576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.951752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.951855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.952068] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.952197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.952277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.952440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.952540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.952646] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84881d5c-05c0-4bde-84e9-437b2da92669 is going to be created. [ 590.008685] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.008839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.008911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.009327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.009510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.022880] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84881d5c-05c0-4bde-84e9-437b2da92669 in Status: IN_PROGRESS for 2s [ 590.222820] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 680ecc24-ba28-4a80-8dbc-c645fd3d33ab [ 590.223086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.223565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.223565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.223565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.223738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.223738] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:680ecc24-ba28-4a80-8dbc-c645fd3d33ab already deleted. [ 590.223815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-680ecc24-ba28-4a80-8dbc-c645fd3d33ab" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.405379] env[65553]: INFO networking_nsxv3.common.synchronization [req-d949b1eb-c784-430b-961d-d06ad6568c20 req-140b7dad-f03f-4cee-aae5-925784397b3f service nova] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_rules [ 590.405379] env[65553]: INFO networking_nsxv3.common.synchronization [req-d949b1eb-c784-430b-961d-d06ad6568c20 req-140b7dad-f03f-4cee-aae5-925784397b3f service nova] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 590.405379] env[65553]: INFO networking_nsxv3.common.synchronization [req-d949b1eb-c784-430b-961d-d06ad6568c20 req-140b7dad-f03f-4cee-aae5-925784397b3f service nova] Enqueued Resource ID: 209ae543-1ee7-40af-a62b-06fa66275317 with Priority: HIGHEST for action port [ 590.405379] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_rules [ 590.405379] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 590.405379] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 209ae543-1ee7-40af-a62b-06fa66275317 with Priority: HIGHEST for action port [ 590.405379] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.405379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.405379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.405379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.405890] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.413745] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.413745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.413745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.413745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.413745] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.413745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.413745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.413745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.413745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.413745] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.413745] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-209ae543-1ee7-40af-a62b-06fa66275317 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.413745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-209ae543-1ee7-40af-a62b-06fa66275317" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.413745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-209ae543-1ee7-40af-a62b-06fa66275317" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.413745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-209ae543-1ee7-40af-a62b-06fa66275317" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.413745] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('209ae543-1ee7-40af-a62b-06fa66275317',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.672357] env[65553]: INFO networking_nsxv3.common.synchronization [req-72e86bbb-7735-4525-9b3a-86c2bfe3f41e req-ae97a495-22d7-468a-b192-0cdcf2dd2815 tempest-ServerExternalEventsTest-672998774 tempest-ServerExternalEventsTest-672998774-project-member] Enqueued Resource ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c with Priority: HIGHEST for action security_group_members [ 590.672919] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c with Priority: HIGHEST for action security_group_members [ 590.673451] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3d9a09b-bf97-4de9-910d-f878fc6b267c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.673631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.673685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.674729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.674729] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.674729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.674729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.674729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.674729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.674729] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3d9a09b-bf97-4de9-910d-f878fc6b267c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.912434] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.912434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.916129] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.918569] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 209ae543-1ee7-40af-a62b-06fa66275317 with status ACTIVE [ 590.918795] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.919944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.919944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.919944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.919944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.919944] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.919944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.919944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.920241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.920241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.920343] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.920501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.920546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.920690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.920766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.920907] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 209ae543-1ee7-40af-a62b-06fa66275317 is going to be updated. [ 590.946545] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.946876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.946876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.946966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.947118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.947274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-209ae543-1ee7-40af-a62b-06fa66275317" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.176728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.176879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.176967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.177209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.177304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.177515] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.177612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.177678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.177853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.177899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.177964] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c already deleted. [ 591.178084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.351586] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.351918] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.351918] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.352169] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.352390] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.352561] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.352761] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.352821] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.352930] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.353209] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.353264] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.353324] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.353428] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.353528] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.353648] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.353824] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.365658] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: SUCCESS [ 591.365891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.367237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.367237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.367237] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.367237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.367237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.367484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.367888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.367888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.367888] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.374294] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.374484] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.374650] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.374840] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.375349] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.375592] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.376014] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.376196] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.376873] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.425024] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.602025] env[65553]: INFO networking_nsxv3.common.synchronization [None req-84536dff-83d7-4c13-86c6-0e7a1cceba08 tempest-VolumesAssistedSnapshotsTest-1096100020 tempest-VolumesAssistedSnapshotsTest-1096100020-project-member] Enqueued Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_rules [ 591.602638] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_rules [ 591.603180] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.603180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.603180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.603386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.603465] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec66a418-d823-4b2f-87e2-c61e09ea9de4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.875564] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.875564] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.875564] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.875564] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.875564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.876378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.876378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.876378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.876378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.876378] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.878227] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.879712] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.879960] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.880298] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.880791] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.881073] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1 not found, creating... [ 591.885145] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.885145] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.885145] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.885145] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.885145] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.885977] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.886413] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.886742] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.887171] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.887421] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.887758] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1 is going to be created. [ 591.910434] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.910434] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.910434] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.910434] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.910434] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.910434] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.930668] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.930668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.930668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.930668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.930668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.930668] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be created. [ 591.971399] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.971736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.971736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.973687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.973687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.983378] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: UNINITIALIZED for 2s [ 592.036714] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84881d5c-05c0-4bde-84e9-437b2da92669 in Status: SUCCESS [ 592.037100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.106948] env[65553]: INFO networking_nsxv3.common.synchronization [req-5dc24d90-9ae4-4392-a491-196127b8d786 req-0c7dec36-2d00-43ca-ae11-6f827a3bce75 tempest-ListServerFiltersTestJSON-2035845723 tempest-ListServerFiltersTestJSON-2035845723-project-member] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 592.108562] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 592.109072] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.109072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.109072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.109318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.109468] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.109607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.109667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.109816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.109860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.110485] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.129909] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.130098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.130162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.130529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.130529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.130529] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 already deleted. [ 592.130723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.317993] env[65553]: INFO networking_nsxv3.common.synchronization [None req-55b8b22a-f070-4ab9-90bb-f9b10bae5bcf tempest-VolumesAssistedSnapshotsTest-1096100020 tempest-VolumesAssistedSnapshotsTest-1096100020-project-member] Enqueued Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_rules [ 592.319946] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_rules [ 592.320278] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.320548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.320548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.320657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.320735] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec66a418-d823-4b2f-87e2-c61e09ea9de4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.378488] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edac77c9-fa82-4dc9-b52a-a8a880305683: rpc.has_security_group_logging(os_id): False [ 592.397493] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.397610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.397683] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.397905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.397996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.398220] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.398320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.398383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.398531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.398605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.398779] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.398905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.398940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.399074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.399150] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.399332] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.399425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.399484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.399619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.400133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.400133] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 is going to be created. [ 592.469166] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.469349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.469390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.469636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.469856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.483860] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: IN_PROGRESS for 2s [ 592.612823] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.613106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.613106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.613304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.613387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.613660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.613794] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.613870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.614060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.614139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.614225] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb already deleted. [ 592.614303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.623720] env[65553]: INFO networking_nsxv3.common.synchronization [req-72e86bbb-7735-4525-9b3a-86c2bfe3f41e req-52b76a09-68a4-44f5-bdac-95b4f37fe8dd service nova] Enqueued Resource ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c with Priority: HIGHEST for action security_group_rules [ 592.623976] env[65553]: INFO networking_nsxv3.common.synchronization [req-72e86bbb-7735-4525-9b3a-86c2bfe3f41e req-52b76a09-68a4-44f5-bdac-95b4f37fe8dd service nova] Enqueued Resource ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c with Priority: HIGHEST for action security_group_members [ 592.624055] env[65553]: INFO networking_nsxv3.common.synchronization [req-72e86bbb-7735-4525-9b3a-86c2bfe3f41e req-52b76a09-68a4-44f5-bdac-95b4f37fe8dd service nova] Enqueued Resource ID: 98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1 with Priority: HIGHEST for action port [ 592.624614] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c with Priority: HIGHEST for action security_group_rules [ 592.625628] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c with Priority: HIGHEST for action security_group_members [ 592.625818] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1 with Priority: HIGHEST for action port [ 592.626140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3d9a09b-bf97-4de9-910d-f878fc6b267c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.626267] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.626334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.626597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.626681] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3d9a09b-bf97-4de9-910d-f878fc6b267c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.628284] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3d9a09b-bf97-4de9-910d-f878fc6b267c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.629046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.629046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.629046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.629046] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.629046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.629046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.629482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.629482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.629482] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3d9a09b-bf97-4de9-910d-f878fc6b267c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.630798] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.630925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.630968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.631924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.631924] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.840592] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.840776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.840776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.840921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.840987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.841105] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 already deleted. [ 592.841188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.133380] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1 with status ACTIVE [ 593.133670] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.133811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.134053] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.134122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.134212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.134395] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.134497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.134551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.134683] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.135113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.135113] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.135113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.135113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.135328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.135328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.135430] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1 is going to be updated. [ 593.136547] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3d9a09b-bf97-4de9-910d-f878fc6b267c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.137473] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3d9a09b-bf97-4de9-910d-f878fc6b267c taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.137598] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.177125] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.177437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.177437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.177517] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.177639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.177814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98eb8e43-ccb9-4c81-8b6f-2e68c1b703b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.307283] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.307496] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.307578] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.307914] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.308187] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.308345] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.308454] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.308674] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.308846] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.309189] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.309389] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.309581] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.309781] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.309981] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.310208] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.310396] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.343367] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.343519] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 593.344119] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.344214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.344499] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-c365ca6d-31a9-47c2-b442-5960cf6fa199 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.344689] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-c365ca6d-31a9-47c2-b442-5960cf6fa199" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.344856] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-c365ca6d-31a9-47c2-b442-5960cf6fa199" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.345233] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-c365ca6d-31a9-47c2-b442-5960cf6fa199" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.345369] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c365ca6d-31a9-47c2-b442-5960cf6fa199',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.609131] env[65553]: INFO networking_nsxv3.common.synchronization [None req-0ea5a453-a01e-4f07-b914-d0022eca0d8c None None] Enqueued Resource ID: 9d73d3c3-d57e-4ff2-83a6-a93b57311612 with Priority: HIGHEST for action port [ 593.609781] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d73d3c3-d57e-4ff2-83a6-a93b57311612 with Priority: HIGHEST for action port [ 593.610143] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d73d3c3-d57e-4ff2-83a6-a93b57311612 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.610270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d73d3c3-d57e-4ff2-83a6-a93b57311612" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.610340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d73d3c3-d57e-4ff2-83a6-a93b57311612" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.610607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d73d3c3-d57e-4ff2-83a6-a93b57311612" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.610718] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d73d3c3-d57e-4ff2-83a6-a93b57311612',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.639064] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3d9a09b-bf97-4de9-910d-f878fc6b267c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.851090] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.851453] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.851453] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.851754] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.851894] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.852078] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port c365ca6d-31a9-47c2-b442-5960cf6fa199 not found, creating... [ 593.852343] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.852498] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.852620] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.852843] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.852987] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.853276] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.853411] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.853522] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.853759] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.853996] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.855092] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: c365ca6d-31a9-47c2-b442-5960cf6fa199 is going to be created. [ 593.879970] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.880197] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.880394] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.880730] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.880977] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.881211] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-c365ca6d-31a9-47c2-b442-5960cf6fa199" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.997527] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 593.997527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.997527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.997527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.997527] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.997527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.997527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.997853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.997853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.997853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.997944] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.113455] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d73d3c3-d57e-4ff2-83a6-a93b57311612 [ 594.113782] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.113902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.113943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.114210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.114367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.114409] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d73d3c3-d57e-4ff2-83a6-a93b57311612 already deleted. [ 594.114451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d73d3c3-d57e-4ff2-83a6-a93b57311612" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.143350] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.143350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.143350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.143675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.143675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.143675] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c is going to be created. [ 594.177081] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.177081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.177081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.177081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.177359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.189349] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c in Status: UNINITIALIZED for 2s [ 594.503335] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: SUCCESS [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.503335] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.503335] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.503335] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.503335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.504668] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.504668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.504668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.504668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.504668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.504668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.504668] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.638789] env[65553]: INFO networking_nsxv3.common.synchronization [req-5dc24d90-9ae4-4392-a491-196127b8d786 req-417fec5e-d197-439b-aac7-ce4b1ce3a225 service nova] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_rules [ 594.639526] env[65553]: INFO networking_nsxv3.common.synchronization [req-5dc24d90-9ae4-4392-a491-196127b8d786 req-417fec5e-d197-439b-aac7-ce4b1ce3a225 service nova] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 594.639721] env[65553]: INFO networking_nsxv3.common.synchronization [req-5dc24d90-9ae4-4392-a491-196127b8d786 req-417fec5e-d197-439b-aac7-ce4b1ce3a225 service nova] Enqueued Resource ID: c365ca6d-31a9-47c2-b442-5960cf6fa199 with Priority: HIGHEST for action port [ 594.643227] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_rules [ 594.643227] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 594.643227] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c365ca6d-31a9-47c2-b442-5960cf6fa199 with Priority: HIGHEST for action port [ 594.643227] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.643227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.643227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.643227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.643227] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.643537] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.643537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.643615] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.643796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.643946] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.644170] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.644831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.645064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.645167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.645272] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.647171] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c365ca6d-31a9-47c2-b442-5960cf6fa199 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.647171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c365ca6d-31a9-47c2-b442-5960cf6fa199" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.647171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c365ca6d-31a9-47c2-b442-5960cf6fa199" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.647171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c365ca6d-31a9-47c2-b442-5960cf6fa199" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.647171] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c365ca6d-31a9-47c2-b442-5960cf6fa199',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.007417] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15032a54-f6e7-41b8-855b-0262e8fb39c5: rpc.has_security_group_logging(os_id): False [ 595.027699] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.027843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.027924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.028178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.028272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.028502] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.029356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.029356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.029356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.029356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.029356] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.029356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.029356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.029356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.029679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.029679] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.029679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.029852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.029852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.029915] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.030031] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be created. [ 595.092958] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.095301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.095301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.095301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.095301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.111155] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 595.148707] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.149845] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.150098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.154362] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c365ca6d-31a9-47c2-b442-5960cf6fa199 with status ACTIVE [ 595.154362] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.154521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.154521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.154664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.154792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.155066] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.155184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.155245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.155455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.155502] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.155688] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.155778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.155947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.156016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.156112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.156213] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c365ca6d-31a9-47c2-b442-5960cf6fa199 is going to be updated. [ 595.198167] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.198318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.198382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.199028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.199028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.199028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c365ca6d-31a9-47c2-b442-5960cf6fa199" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.503525] env[65553]: INFO networking_nsxv3.common.synchronization [req-39375875-1630-40ca-8693-37bc6670f9ae req-bdb9b896-9f7d-48d4-b0b4-e42b719bd3bb tempest-ServerPasswordTestJSON-1282297697 tempest-ServerPasswordTestJSON-1282297697-project-member] Enqueued Resource ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f with Priority: HIGHEST for action security_group_members [ 595.504104] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f with Priority: HIGHEST for action security_group_members [ 595.504220] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad458bc8-8a48-49a7-9f97-e510476fdf4f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.504367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.504367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.505087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.505281] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.505377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.505431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.505594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.505680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.505776] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad458bc8-8a48-49a7-9f97-e510476fdf4f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.651415] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.728479] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f0619d47-d9ef-4c2c-a88e-a54158bd144c None None] Enqueued Resource ID: 573b7d6f-66b2-4ead-b24a-aef2368de2f7 with Priority: HIGHEST for action port [ 595.729054] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 573b7d6f-66b2-4ead-b24a-aef2368de2f7 with Priority: HIGHEST for action port [ 595.729412] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-573b7d6f-66b2-4ead-b24a-aef2368de2f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.729583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-573b7d6f-66b2-4ead-b24a-aef2368de2f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.729690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-573b7d6f-66b2-4ead-b24a-aef2368de2f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.729979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-573b7d6f-66b2-4ead-b24a-aef2368de2f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.730187] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('573b7d6f-66b2-4ead-b24a-aef2368de2f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.010410] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.010410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.010410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.010410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.010410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.010410] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.011447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.011447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.011447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.011447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.011447] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f already deleted. [ 596.011447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.155679] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.155679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.155679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.155679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.155679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.155679] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be created. [ 596.185391] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.185391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.185391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.185391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.185391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.199943] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: UNINITIALIZED for 2s [ 596.201184] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c in Status: SUCCESS [ 596.201408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.201802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.202084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.202281] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.202403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.202459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.203154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.203292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.203394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.203491] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3d9a09b-bf97-4de9-910d-f878fc6b267c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.233265] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 573b7d6f-66b2-4ead-b24a-aef2368de2f7 [ 596.233265] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.233477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.233477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.233573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.233740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.234587] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:573b7d6f-66b2-4ead-b24a-aef2368de2f7 already deleted. [ 596.234587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-573b7d6f-66b2-4ead-b24a-aef2368de2f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.390512] env[65553]: INFO networking_nsxv3.common.synchronization [None req-1e103440-f416-48c6-90f5-0716ba093a50 None None] Enqueued Resource ID: 4c1f45da-55bf-420a-876b-3aa0ffa88c21 with Priority: HIGHEST for action port [ 596.390512] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1f45da-55bf-420a-876b-3aa0ffa88c21 with Priority: HIGHEST for action port [ 596.390954] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c1f45da-55bf-420a-876b-3aa0ffa88c21 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.391514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c1f45da-55bf-420a-876b-3aa0ffa88c21" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.391730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c1f45da-55bf-420a-876b-3aa0ffa88c21" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.392024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c1f45da-55bf-420a-876b-3aa0ffa88c21" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.392398] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c1f45da-55bf-420a-876b-3aa0ffa88c21',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.603711] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.603956] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-588" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.604089] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-588" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.604450] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-588" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.604776] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.604977] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.605362] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.605616] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.606021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.606021] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.606135] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.606194] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.606301] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.606408] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.606504] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.606629] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.627571] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.627742] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 596.627881] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.628075] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-588" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.628384] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-8cffedd8-5455-4437-9ad9-9904080e6462 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.628555] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-8cffedd8-5455-4437-9ad9-9904080e6462" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.628667] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-8cffedd8-5455-4437-9ad9-9904080e6462" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.629042] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-8cffedd8-5455-4437-9ad9-9904080e6462" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.629124] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cffedd8-5455-4437-9ad9-9904080e6462',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.706883] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3d9a09b-bf97-4de9-910d-f878fc6b267c taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.707090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.707150] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.707339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.707509] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.707610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.707668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.707815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.707901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.707987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.708150] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3d9a09b-bf97-4de9-910d-f878fc6b267c taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.708242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.708299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.708438] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.708571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.708661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.708776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.708865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.708955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.709050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.709138] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3d9a09b-bf97-4de9-910d-f878fc6b267c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.896085] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c1f45da-55bf-420a-876b-3aa0ffa88c21 [ 596.896085] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.896085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.896085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.896085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.896085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.896085] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c1f45da-55bf-420a-876b-3aa0ffa88c21 already deleted. [ 596.896085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c1f45da-55bf-420a-876b-3aa0ffa88c21" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.126081] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 597.126312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.133443] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.133638] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.133846] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.134076] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.134226] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.134375] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 8cffedd8-5455-4437-9ad9-9904080e6462 not found, creating... [ 597.134705] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.134836] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.134915] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.135150] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.135621] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.136069] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.137318] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.137449] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.137667] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.137921] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.137979] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 8cffedd8-5455-4437-9ad9-9904080e6462 is going to be created. [ 597.159606] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.160074] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.160074] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.160304] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.160408] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.160614] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-8cffedd8-5455-4437-9ad9-9904080e6462" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.211451] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3d9a09b-bf97-4de9-910d-f878fc6b267c: rpc.has_security_group_logging(os_id): False [ 597.250762] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.250762] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.250762] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.250762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.251298] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.251298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.251298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.251298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.251298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.251298] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c is going to be created. [ 597.269146] env[65553]: INFO networking_nsxv3.common.synchronization [None req-b9924ff8-ac5d-4e3e-9ffa-1b72e2e7509e None None] Enqueued Resource ID: 47676b0a-c3aa-4d0f-bc12-914c8ac5ce57 with Priority: HIGHEST for action port [ 597.269711] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47676b0a-c3aa-4d0f-bc12-914c8ac5ce57 with Priority: HIGHEST for action port [ 597.270727] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-47676b0a-c3aa-4d0f-bc12-914c8ac5ce57 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.270916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47676b0a-c3aa-4d0f-bc12-914c8ac5ce57" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.270976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47676b0a-c3aa-4d0f-bc12-914c8ac5ce57" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.271248] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47676b0a-c3aa-4d0f-bc12-914c8ac5ce57" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.271330] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47676b0a-c3aa-4d0f-bc12-914c8ac5ce57',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.339595] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.339595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.339595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.339736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.339813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.352544] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c in Status: IN_PROGRESS for 2s [ 597.775751] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47676b0a-c3aa-4d0f-bc12-914c8ac5ce57 [ 597.775751] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.775751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.775751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.775751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.775751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.775751] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47676b0a-c3aa-4d0f-bc12-914c8ac5ce57 already deleted. [ 597.775751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47676b0a-c3aa-4d0f-bc12-914c8ac5ce57" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.858546] env[65553]: INFO networking_nsxv3.common.synchronization [req-39375875-1630-40ca-8693-37bc6670f9ae req-c686ae9c-fa5c-43e0-9894-f256809c5874 service nova] Enqueued Resource ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f with Priority: HIGHEST for action security_group_rules [ 597.858774] env[65553]: INFO networking_nsxv3.common.synchronization [req-39375875-1630-40ca-8693-37bc6670f9ae req-c686ae9c-fa5c-43e0-9894-f256809c5874 service nova] Enqueued Resource ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f with Priority: HIGHEST for action security_group_members [ 597.859310] env[65553]: INFO networking_nsxv3.common.synchronization [req-39375875-1630-40ca-8693-37bc6670f9ae req-c686ae9c-fa5c-43e0-9894-f256809c5874 service nova] Enqueued Resource ID: 8cffedd8-5455-4437-9ad9-9904080e6462 with Priority: HIGHEST for action port [ 597.859931] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f with Priority: HIGHEST for action security_group_rules [ 597.860440] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f with Priority: HIGHEST for action security_group_members [ 597.860440] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cffedd8-5455-4437-9ad9-9904080e6462 with Priority: HIGHEST for action port [ 597.860440] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad458bc8-8a48-49a7-9f97-e510476fdf4f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.860592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.860668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.860946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.861109] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad458bc8-8a48-49a7-9f97-e510476fdf4f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.861947] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad458bc8-8a48-49a7-9f97-e510476fdf4f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.862080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.862303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.862361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.862476] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.862571] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.862630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.862768] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.862852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.862957] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad458bc8-8a48-49a7-9f97-e510476fdf4f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.864913] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cffedd8-5455-4437-9ad9-9904080e6462 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.864913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cffedd8-5455-4437-9ad9-9904080e6462" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.864913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cffedd8-5455-4437-9ad9-9904080e6462" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.864913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cffedd8-5455-4437-9ad9-9904080e6462" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.864913] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cffedd8-5455-4437-9ad9-9904080e6462',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.216022] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 598.216022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.216022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.216022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.216022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.216022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.216022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.216022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.216022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.216022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.216022] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.219117] env[65553]: INFO networking_nsxv3.common.synchronization [None req-ccd05d50-662d-47b6-9ae7-c5188df6cbc2 None None] Enqueued Resource ID: f58a07a6-cf42-4540-8873-6b42bf91027f with Priority: HIGHEST for action port [ 598.220581] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58a07a6-cf42-4540-8873-6b42bf91027f with Priority: HIGHEST for action port [ 598.221118] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-f58a07a6-cf42-4540-8873-6b42bf91027f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.221412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f58a07a6-cf42-4540-8873-6b42bf91027f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.221713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f58a07a6-cf42-4540-8873-6b42bf91027f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.222072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f58a07a6-cf42-4540-8873-6b42bf91027f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.223505] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f58a07a6-cf42-4540-8873-6b42bf91027f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.368405] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad458bc8-8a48-49a7-9f97-e510476fdf4f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.370370] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad458bc8-8a48-49a7-9f97-e510476fdf4f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.370370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.370370] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8cffedd8-5455-4437-9ad9-9904080e6462 with status ACTIVE [ 598.370565] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.370565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.370653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.370804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.370906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.371138] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.371240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.371303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.371464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.371544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.372980] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.373184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.373324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.373537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.373703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.373853] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8cffedd8-5455-4437-9ad9-9904080e6462 is going to be updated. [ 598.409118] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.409118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.409118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.409118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.409118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.409118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cffedd8-5455-4437-9ad9-9904080e6462" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.721098] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.721319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.721319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.721562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.721853] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.721963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.722037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.722215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.722305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.722391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.722536] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.722624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.722679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.722830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.722972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.723086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.723143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.723283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.723362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.723446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.723536] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.727996] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f58a07a6-cf42-4540-8873-6b42bf91027f [ 598.729239] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.731087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.731087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.731087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.731087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.731087] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f58a07a6-cf42-4540-8873-6b42bf91027f already deleted. [ 598.731087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f58a07a6-cf42-4540-8873-6b42bf91027f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.834432] env[65553]: INFO networking_nsxv3.common.synchronization [req-54dd9c75-6241-4af7-a305-1e65488bf945 req-df3e887a-12ae-429c-b698-31c4d9d62d80 tempest-ListServerFiltersTestJSON-2035845723 tempest-ListServerFiltersTestJSON-2035845723-project-member] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 598.835909] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 598.836362] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.836845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.836845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.836956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.837250] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.837487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.837698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.837986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.838189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.838414] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.877917] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad458bc8-8a48-49a7-9f97-e510476fdf4f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.228323] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb: rpc.has_security_group_logging(os_id): False [ 599.252045] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.252045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.252045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.252045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.252045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.253026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.253177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.253226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.253670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.253670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.253995] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.253995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.253995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.254160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.254199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.254414] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.254534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.254702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.254878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.254973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.255131] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be created. [ 599.329503] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.329503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.329503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.329503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.329503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.333873] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.334107] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.334426] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.334822] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.335019] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.335179] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.335293] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.335504] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.335636] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.335836] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.335937] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.336074] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.336195] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.336299] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.336395] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.336517] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.341995] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.347572] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: IN_PROGRESS for 2s [ 599.360688] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.361028] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.361225] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.361431] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.361775] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.361986] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.362145] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.362523] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.362689] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.367735] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c in Status: SUCCESS [ 599.367963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.381891] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.382058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.383326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.383326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.383326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.383326] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f is going to be created. [ 599.414540] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.414814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.414814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.415072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.415147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.429431] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f in Status: UNINITIALIZED for 2s [ 599.843660] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.866350] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.866647] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.866731] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.866976] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.867133] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.867287] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a not found, creating... [ 599.867539] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.867694] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.867808] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.868026] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.868160] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.868438] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.868582] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.868693] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.868901] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.869039] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.869222] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a is going to be created. [ 599.896954] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.897279] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.897645] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.898162] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.898541] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.898901] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.172308] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f5ef692a-b383-4271-b8d2-adab2e9b68a3 None None] Enqueued Resource ID: e04bbe36-8210-4df6-9b72-38a37a8ab25b with Priority: HIGHEST for action port [ 600.172308] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04bbe36-8210-4df6-9b72-38a37a8ab25b with Priority: HIGHEST for action port [ 600.172765] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e04bbe36-8210-4df6-9b72-38a37a8ab25b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.172765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e04bbe36-8210-4df6-9b72-38a37a8ab25b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.172765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e04bbe36-8210-4df6-9b72-38a37a8ab25b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.173223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e04bbe36-8210-4df6-9b72-38a37a8ab25b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.173223] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e04bbe36-8210-4df6-9b72-38a37a8ab25b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.348465] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.348465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.348465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.348465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.348465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.348465] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be updated. [ 600.396392] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.396657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.396714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.396971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.397181] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.408864] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: IN_PROGRESS for 2s [ 600.680577] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e04bbe36-8210-4df6-9b72-38a37a8ab25b [ 600.680909] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.681078] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.681151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.681442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.681582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.681688] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e04bbe36-8210-4df6-9b72-38a37a8ab25b already deleted. [ 600.681947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e04bbe36-8210-4df6-9b72-38a37a8ab25b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.725953] env[65553]: INFO networking_nsxv3.common.synchronization [req-54dd9c75-6241-4af7-a305-1e65488bf945 req-fdb970a5-56a6-4370-8668-37cfb87f7f05 service nova] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_rules [ 600.726349] env[65553]: INFO networking_nsxv3.common.synchronization [req-54dd9c75-6241-4af7-a305-1e65488bf945 req-fdb970a5-56a6-4370-8668-37cfb87f7f05 service nova] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 600.726539] env[65553]: INFO networking_nsxv3.common.synchronization [req-54dd9c75-6241-4af7-a305-1e65488bf945 req-fdb970a5-56a6-4370-8668-37cfb87f7f05 service nova] Enqueued Resource ID: 3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a with Priority: HIGHEST for action port [ 600.727324] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_rules [ 600.727617] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 600.727668] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a with Priority: HIGHEST for action port [ 600.727976] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.728194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.728454] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.728553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.728812] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.729065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.729065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.729268] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.729409] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.234215] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a with status ACTIVE [ 601.234215] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.234215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.234804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.235274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.235430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.235971] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.236142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.236270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.236460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.236543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.236905] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.237106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.237161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.238512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.238512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.238512] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a is going to be updated. [ 601.268781] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.270507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.270669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.270948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.271168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.271525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a2c1f66-0d4e-4f7c-ac9f-2f4800b1de7a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.370234] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 601.370656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.370784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.372016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.372016] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.443466] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f in Status: SUCCESS [ 601.443985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.443985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.444171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.444313] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.444465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.444529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.444728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.444795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.444795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.444979] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad458bc8-8a48-49a7-9f97-e510476fdf4f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.757017] env[65553]: INFO networking_nsxv3.common.synchronization [req-211e94c5-1f55-46da-a11e-b165f5871048 req-8865e29f-f2d2-4e21-bc7c-a06f41d45c63 tempest-ServerTagsTestJSON-23482399 tempest-ServerTagsTestJSON-23482399-project-member] Enqueued Resource ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 with Priority: HIGHEST for action security_group_members [ 601.757217] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 with Priority: HIGHEST for action security_group_members [ 601.757503] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e7647e8-bc93-4ca1-af77-c7da9c980011 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.757628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.757694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.760482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.760482] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.760482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.760482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.760482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.760482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.760482] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e7647e8-bc93-4ca1-af77-c7da9c980011',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.876471] env[65553]: INFO networking_nsxv3.common.synchronization [None req-115ff095-589b-4cd0-a162-e170b4a9fe5e None None] Enqueued Resource ID: 23c58355-225a-47a5-bd29-104abc6d40d4 with Priority: HIGHEST for action port [ 601.876471] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.876471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.876471] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c58355-225a-47a5-bd29-104abc6d40d4 with Priority: HIGHEST for action port [ 601.877869] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-23c58355-225a-47a5-bd29-104abc6d40d4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.877869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23c58355-225a-47a5-bd29-104abc6d40d4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.877869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23c58355-225a-47a5-bd29-104abc6d40d4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.877869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23c58355-225a-47a5-bd29-104abc6d40d4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.877869] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23c58355-225a-47a5-bd29-104abc6d40d4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.946899] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad458bc8-8a48-49a7-9f97-e510476fdf4f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.947602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.947682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.947921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.948109] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.948813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.948813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.948813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.948813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.948813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.949010] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad458bc8-8a48-49a7-9f97-e510476fdf4f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.949176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.949221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.951434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.951434] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.951434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.951434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.951434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.951434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.951434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.951434] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad458bc8-8a48-49a7-9f97-e510476fdf4f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.263680] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.263680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.263680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.264036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.264176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.264438] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.264574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.264640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.264838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.264944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.265063] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 already deleted. [ 602.265162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.269072] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.269345] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-835" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.269382] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-835" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.269795] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-835" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.270112] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.270499] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.270499] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.270701] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.270926] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.274859] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.274859] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.274859] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.274859] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.274859] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.274859] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.274859] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.297331] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.297331] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.297331] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.297331] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-835" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.297331] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-d05fc02f-878b-4787-afd6-e8c38e901be7 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.297331] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-d05fc02f-878b-4787-afd6-e8c38e901be7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.297331] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-d05fc02f-878b-4787-afd6-e8c38e901be7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.297331] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-d05fc02f-878b-4787-afd6-e8c38e901be7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.297331] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d05fc02f-878b-4787-afd6-e8c38e901be7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.382125] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23c58355-225a-47a5-bd29-104abc6d40d4 [ 602.382125] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.382125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.382125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.382610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.382610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.382610] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23c58355-225a-47a5-bd29-104abc6d40d4 already deleted. [ 602.382709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23c58355-225a-47a5-bd29-104abc6d40d4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.425163] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 602.425163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.425163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.425163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.425163] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.425163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.425163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.425163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.425163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.425163] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.453895] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad458bc8-8a48-49a7-9f97-e510476fdf4f: rpc.has_security_group_logging(os_id): False [ 602.481940] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.482312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.482312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.482606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.482755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.483058] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.483228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.483352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.483801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.483932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.485073] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.485073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.485073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.485073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.485073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.485073] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.485637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.485637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.485637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.485637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.485901] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f is going to be created. [ 602.563399] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.563399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.563399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.563399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.563399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.578315] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f in Status: IN_PROGRESS for 2s [ 602.804238] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.804340] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.804711] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.804799] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.804950] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.805456] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port d05fc02f-878b-4787-afd6-e8c38e901be7 not found, creating... [ 602.805456] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.805632] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.805748] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.806151] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.806239] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.806521] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.806692] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.806812] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.807127] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.807311] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.807452] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: d05fc02f-878b-4787-afd6-e8c38e901be7 is going to be created. [ 602.830362] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.830565] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.830679] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.830981] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.831293] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.831461] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-d05fc02f-878b-4787-afd6-e8c38e901be7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.933781] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.436546] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.565222] env[65553]: INFO networking_nsxv3.common.synchronization [req-211e94c5-1f55-46da-a11e-b165f5871048 req-375cd59a-689c-4d1e-8a83-b473512fd75e service nova] Enqueued Resource ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 with Priority: HIGHEST for action security_group_rules [ 603.565222] env[65553]: INFO networking_nsxv3.common.synchronization [req-211e94c5-1f55-46da-a11e-b165f5871048 req-375cd59a-689c-4d1e-8a83-b473512fd75e service nova] Enqueued Resource ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 with Priority: HIGHEST for action security_group_members [ 603.565222] env[65553]: INFO networking_nsxv3.common.synchronization [req-211e94c5-1f55-46da-a11e-b165f5871048 req-375cd59a-689c-4d1e-8a83-b473512fd75e service nova] Enqueued Resource ID: d05fc02f-878b-4787-afd6-e8c38e901be7 with Priority: HIGHEST for action port [ 603.566244] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 with Priority: HIGHEST for action security_group_rules [ 603.567036] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 with Priority: HIGHEST for action security_group_members [ 603.567036] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d05fc02f-878b-4787-afd6-e8c38e901be7 with Priority: HIGHEST for action port [ 603.567226] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e7647e8-bc93-4ca1-af77-c7da9c980011 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.567429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.567598] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.568036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.568190] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e7647e8-bc93-4ca1-af77-c7da9c980011',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.569477] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e7647e8-bc93-4ca1-af77-c7da9c980011 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.569694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.570166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.570486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.570710] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.570843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.570923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.571155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.571275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.571397] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e7647e8-bc93-4ca1-af77-c7da9c980011',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.574786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d05fc02f-878b-4787-afd6-e8c38e901be7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.574877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d05fc02f-878b-4787-afd6-e8c38e901be7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.574929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d05fc02f-878b-4787-afd6-e8c38e901be7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.575126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d05fc02f-878b-4787-afd6-e8c38e901be7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.575203] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d05fc02f-878b-4787-afd6-e8c38e901be7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.941102] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.941328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.941381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.941657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.941759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.941878] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be updated. [ 603.972996] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.973214] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.973381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.973527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.974241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.985167] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: IN_PROGRESS for 2s [ 604.077040] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e7647e8-bc93-4ca1-af77-c7da9c980011',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.078256] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e7647e8-bc93-4ca1-af77-c7da9c980011 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.078365] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.078516] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d05fc02f-878b-4787-afd6-e8c38e901be7 with status ACTIVE [ 604.078696] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.078810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.078884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.079343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.079343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.079343] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.079478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.079509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.079640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.079705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.082941] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.082941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.082941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.082941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.082941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.082941] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d05fc02f-878b-4787-afd6-e8c38e901be7 is going to be updated. [ 604.106683] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.106839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.106916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.107150] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.107652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.108403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d05fc02f-878b-4787-afd6-e8c38e901be7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.583484] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e7647e8-bc93-4ca1-af77-c7da9c980011',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.593317] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f in Status: SUCCESS [ 604.593317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.820103] env[65553]: INFO networking_nsxv3.common.synchronization [None req-e7c71566-2d7b-401b-af13-740b714b5413 None None] Enqueued Resource ID: 2f72e04f-cffb-44a0-adb1-d8cb73f36238 with Priority: HIGHEST for action port [ 604.820103] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f72e04f-cffb-44a0-adb1-d8cb73f36238 with Priority: HIGHEST for action port [ 604.820103] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f72e04f-cffb-44a0-adb1-d8cb73f36238 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.820551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f72e04f-cffb-44a0-adb1-d8cb73f36238" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.821392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f72e04f-cffb-44a0-adb1-d8cb73f36238" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.821392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f72e04f-cffb-44a0-adb1-d8cb73f36238" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.821392] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f72e04f-cffb-44a0-adb1-d8cb73f36238',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.087942] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.088124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.088188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.088396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.088598] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.088598] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 is going to be created. [ 605.118198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.118198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.118198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.118198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.118198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.127851] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 in Status: UNINITIALIZED for 2s [ 605.140822] env[65553]: INFO networking_nsxv3.common.synchronization [req-c7250253-79c3-4d31-b748-3acb7df723fa req-1cf6f62d-12b8-48ff-8a5e-807d508a3bec tempest-ListServerFiltersTestJSON-2035845723 tempest-ListServerFiltersTestJSON-2035845723-project-member] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 605.141394] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 605.141712] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.141858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.324233] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f72e04f-cffb-44a0-adb1-d8cb73f36238 [ 605.324433] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.324583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.324655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.324869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.324986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.326287] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f72e04f-cffb-44a0-adb1-d8cb73f36238 already deleted. [ 605.326394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f72e04f-cffb-44a0-adb1-d8cb73f36238" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.529199] env[65553]: INFO networking_nsxv3.common.synchronization [None req-946610a3-e72d-4adc-a197-901647f2b1c0 None None] Enqueued Resource ID: d791eebf-6f99-4f1b-9999-66b6fc4a0b9c with Priority: HIGHEST for action port [ 605.530234] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d791eebf-6f99-4f1b-9999-66b6fc4a0b9c with Priority: HIGHEST for action port [ 605.530575] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d791eebf-6f99-4f1b-9999-66b6fc4a0b9c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.530703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d791eebf-6f99-4f1b-9999-66b6fc4a0b9c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.530761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d791eebf-6f99-4f1b-9999-66b6fc4a0b9c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.532258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d791eebf-6f99-4f1b-9999-66b6fc4a0b9c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.532635] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d791eebf-6f99-4f1b-9999-66b6fc4a0b9c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.886484] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.886846] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.886846] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.887059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.887314] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.887484] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.887659] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.887894] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.888048] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.888254] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.888360] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.888463] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.888563] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.888664] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.888762] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.888884] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.909856] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.910055] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.910202] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.910400] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-852" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.910711] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-bc74d4b5-686a-4f73-b5fd-5b6fce94145f taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.911016] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-bc74d4b5-686a-4f73-b5fd-5b6fce94145f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.911016] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-bc74d4b5-686a-4f73-b5fd-5b6fce94145f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.911392] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-bc74d4b5-686a-4f73-b5fd-5b6fce94145f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.911600] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc74d4b5-686a-4f73-b5fd-5b6fce94145f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.996965] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 605.997203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.997377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.997589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.997782] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.997902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.997964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.998135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.998215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.998299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.998396] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.000110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.000371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.000448] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.000555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.000618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.000758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.000837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.000922] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.037627] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d791eebf-6f99-4f1b-9999-66b6fc4a0b9c [ 606.037847] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.037985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.038066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.038304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.038399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.038493] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d791eebf-6f99-4f1b-9999-66b6fc4a0b9c already deleted. [ 606.038573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d791eebf-6f99-4f1b-9999-66b6fc4a0b9c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.417288] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.417288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.417288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.417288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.417288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.417288] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port bc74d4b5-686a-4f73-b5fd-5b6fce94145f not found, creating... [ 606.417288] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.417288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.417288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.417288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.417288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.417666] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.417666] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.417666] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.417930] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.418235] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.418503] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: bc74d4b5-686a-4f73-b5fd-5b6fce94145f is going to be created. [ 606.441105] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.441105] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.441105] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.441105] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.441105] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.441105] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-bc74d4b5-686a-4f73-b5fd-5b6fce94145f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.501989] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.501989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.507447] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.009368] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.138291] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 in Status: SUCCESS [ 607.138542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.138652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.138880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.139084] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.139335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.139335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.139431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.139510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.139567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.139657] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e7647e8-bc93-4ca1-af77-c7da9c980011',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.145623] env[65553]: INFO networking_nsxv3.common.synchronization [req-c7250253-79c3-4d31-b748-3acb7df723fa req-5f09bccb-19db-4101-b5b9-49abfeca5720 service nova] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_rules [ 607.145623] env[65553]: INFO networking_nsxv3.common.synchronization [req-c7250253-79c3-4d31-b748-3acb7df723fa req-5f09bccb-19db-4101-b5b9-49abfeca5720 service nova] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 607.145623] env[65553]: INFO networking_nsxv3.common.synchronization [req-c7250253-79c3-4d31-b748-3acb7df723fa req-5f09bccb-19db-4101-b5b9-49abfeca5720 service nova] Enqueued Resource ID: bc74d4b5-686a-4f73-b5fd-5b6fce94145f with Priority: HIGHEST for action port [ 607.145623] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_rules [ 607.145623] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 607.145623] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc74d4b5-686a-4f73-b5fd-5b6fce94145f with Priority: HIGHEST for action port [ 607.145807] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.145907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.146448] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.146550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.146918] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc74d4b5-686a-4f73-b5fd-5b6fce94145f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.146918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc74d4b5-686a-4f73-b5fd-5b6fce94145f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.146918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc74d4b5-686a-4f73-b5fd-5b6fce94145f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.147179] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc74d4b5-686a-4f73-b5fd-5b6fce94145f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.147179] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc74d4b5-686a-4f73-b5fd-5b6fce94145f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.512216] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.512367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.512441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.512656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.512747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.512873] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be updated. [ 607.543602] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.543810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.543857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.544156] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.544329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.555030] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: IN_PROGRESS for 2s [ 607.641725] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e7647e8-bc93-4ca1-af77-c7da9c980011 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.641963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.642086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.642300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.642519] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.642654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.642898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.642981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.643061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.643186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.643385] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e7647e8-bc93-4ca1-af77-c7da9c980011 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.643514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.643600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.643841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.643998] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.644117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.644206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.644469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.644572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.644619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.644716] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e7647e8-bc93-4ca1-af77-c7da9c980011',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.648923] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc74d4b5-686a-4f73-b5fd-5b6fce94145f with status ACTIVE [ 607.649182] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.649331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.649426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.650028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.650028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.650449] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.650657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.650657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.650960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.650960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.651223] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.651353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.651580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.651627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.651734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.651846] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc74d4b5-686a-4f73-b5fd-5b6fce94145f is going to be updated. [ 607.680411] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.680592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.680592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.681305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.681448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.681620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc74d4b5-686a-4f73-b5fd-5b6fce94145f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.831021] env[65553]: INFO networking_nsxv3.common.synchronization [None req-783b84d9-3528-4c12-88b8-d09489e583a5 None None] Enqueued Resource ID: c9f30c3c-742b-4ec4-afae-0426b12e633f with Priority: HIGHEST for action port [ 607.831021] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f30c3c-742b-4ec4-afae-0426b12e633f with Priority: HIGHEST for action port [ 607.831021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9f30c3c-742b-4ec4-afae-0426b12e633f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.831021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9f30c3c-742b-4ec4-afae-0426b12e633f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.831021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9f30c3c-742b-4ec4-afae-0426b12e633f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.831453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9f30c3c-742b-4ec4-afae-0426b12e633f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.831735] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9f30c3c-742b-4ec4-afae-0426b12e633f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.147539] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e7647e8-bc93-4ca1-af77-c7da9c980011: rpc.has_security_group_logging(os_id): False [ 608.174376] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.174587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.174639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.174891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.175000] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.175310] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.175428] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.175490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.175654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.175729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.175939] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.176612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.176747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.176943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.177085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.177324] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.177465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.177560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.177983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.178128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.178267] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 is going to be created. [ 608.241180] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.241180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.241413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.241730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.241908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.260482] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 in Status: IN_PROGRESS for 2s [ 608.313080] env[65553]: INFO networking_nsxv3.common.synchronization [None req-401664bb-a73f-4e13-bc64-b0b488c428dd None None] Enqueued Resource ID: 64f1562d-d312-4a5e-9ce6-3fce5994be12 with Priority: HIGHEST for action port [ 608.313080] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f1562d-d312-4a5e-9ce6-3fce5994be12 with Priority: HIGHEST for action port [ 608.313629] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-64f1562d-d312-4a5e-9ce6-3fce5994be12 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.314276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64f1562d-d312-4a5e-9ce6-3fce5994be12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.314276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64f1562d-d312-4a5e-9ce6-3fce5994be12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.316209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64f1562d-d312-4a5e-9ce6-3fce5994be12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.316209] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64f1562d-d312-4a5e-9ce6-3fce5994be12',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.337779] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9f30c3c-742b-4ec4-afae-0426b12e633f [ 608.338187] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.338376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.338725] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.338725] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.338837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.338939] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9f30c3c-742b-4ec4-afae-0426b12e633f already deleted. [ 608.339490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9f30c3c-742b-4ec4-afae-0426b12e633f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.817665] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64f1562d-d312-4a5e-9ce6-3fce5994be12 [ 608.817785] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.817933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.818008] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.818262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.818412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.818521] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64f1562d-d312-4a5e-9ce6-3fce5994be12 already deleted. [ 608.818610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64f1562d-d312-4a5e-9ce6-3fce5994be12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.013884] env[65553]: INFO networking_nsxv3.common.synchronization [None req-32573c7a-d4a3-431a-85b6-9fc7c9f4eb2d None None] Enqueued Resource ID: 94d5fe13-dcfe-4b88-a2be-321b5b041233 with Priority: HIGHEST for action port [ 609.016080] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d5fe13-dcfe-4b88-a2be-321b5b041233 with Priority: HIGHEST for action port [ 609.016436] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-94d5fe13-dcfe-4b88-a2be-321b5b041233 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.016664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94d5fe13-dcfe-4b88-a2be-321b5b041233" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.016664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94d5fe13-dcfe-4b88-a2be-321b5b041233" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.016904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94d5fe13-dcfe-4b88-a2be-321b5b041233" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.016990] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94d5fe13-dcfe-4b88-a2be-321b5b041233',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.519277] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94d5fe13-dcfe-4b88-a2be-321b5b041233 [ 609.519541] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.519672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.519788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.520106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.520254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.520475] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94d5fe13-dcfe-4b88-a2be-321b5b041233 already deleted. [ 609.520595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94d5fe13-dcfe-4b88-a2be-321b5b041233" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.568403] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 609.568403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.568403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.572242] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.572242] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.572242] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.572242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.572242] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.573141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.573141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.573141] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.573141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.573141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.573141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.573141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.573141] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.611174] env[65553]: INFO networking_nsxv3.common.synchronization [req-6f8894df-b443-41b2-8e5c-392fffa862ac req-3661c5ab-518a-4fb6-9451-0274c2b49969 tempest-VolumesAssistedSnapshotsTest-1096100020 tempest-VolumesAssistedSnapshotsTest-1096100020-project-member] Enqueued Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_members [ 609.611683] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_members [ 609.612023] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec66a418-d823-4b2f-87e2-c61e09ea9de4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.612168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.612246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.612880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.613111] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.613254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.613342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.613570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.614070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.614227] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec66a418-d823-4b2f-87e2-c61e09ea9de4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.998636] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.999489] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-820" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.999637] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-820" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.000073] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-820" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.000395] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.000616] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.000761] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.001047] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.001235] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.001523] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.001709] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.001860] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.001940] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.002041] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.002188] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.002368] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.028029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.028029] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.028029] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.028029] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-820" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.028029] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-ddd60594-31d1-4213-8ed1-19ff2db18489 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.028029] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-ddd60594-31d1-4213-8ed1-19ff2db18489" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.028029] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-ddd60594-31d1-4213-8ed1-19ff2db18489" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.028029] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-ddd60594-31d1-4213-8ed1-19ff2db18489" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.028029] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd60594-31d1-4213-8ed1-19ff2db18489',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.075747] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb: rpc.has_security_group_logging(os_id): False [ 610.076921] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.100290] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.100431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.100501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.100704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.100799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.101038] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.101152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.101195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.101362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.101441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.101628] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.101720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.101812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.101973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.102060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.102469] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.102944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.103051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.103220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.103303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.103431] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be updated. [ 610.116417] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.116595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.116699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.116967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.117077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.117340] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.117416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.117479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.117638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.117718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.117802] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 already deleted. [ 610.117884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.177140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.177140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.177140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.177140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.177140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.194697] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: IN_PROGRESS for 2s [ 610.284412] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 in Status: SUCCESS [ 610.284691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.533174] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.533174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.533174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.533174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.533174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.533174] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port ddd60594-31d1-4213-8ed1-19ff2db18489 not found, creating... [ 610.533174] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.533174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.533174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.533174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.533174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.534412] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.534855] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.535157] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.535563] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.535822] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.536067] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: ddd60594-31d1-4213-8ed1-19ff2db18489 is going to be created. [ 610.559859] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.560280] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.560519] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.560999] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.561564] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.561915] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-ddd60594-31d1-4213-8ed1-19ff2db18489" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.582753] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.898375] env[65553]: INFO networking_nsxv3.common.synchronization [None req-a62d2ded-c576-4655-b863-0fe35f11a4d3 None None] Enqueued Resource ID: 2d54328c-d1b5-49c2-8d50-fd614ccd99e4 with Priority: HIGHEST for action port [ 610.898375] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d54328c-d1b5-49c2-8d50-fd614ccd99e4 with Priority: HIGHEST for action port [ 610.898375] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d54328c-d1b5-49c2-8d50-fd614ccd99e4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.898375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d54328c-d1b5-49c2-8d50-fd614ccd99e4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.898375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d54328c-d1b5-49c2-8d50-fd614ccd99e4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.898375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d54328c-d1b5-49c2-8d50-fd614ccd99e4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.898375] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d54328c-d1b5-49c2-8d50-fd614ccd99e4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.087020] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.087020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.087020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.087278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.087278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.087368] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be updated. [ 611.117169] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.117324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.117394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.117621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.117796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.129088] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: IN_PROGRESS for 2s [ 611.330073] env[65553]: INFO networking_nsxv3.common.synchronization [req-6f8894df-b443-41b2-8e5c-392fffa862ac req-18767720-6a02-4e6f-af05-b9e68f296a12 service nova] Enqueued Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_rules [ 611.330073] env[65553]: INFO networking_nsxv3.common.synchronization [req-6f8894df-b443-41b2-8e5c-392fffa862ac req-18767720-6a02-4e6f-af05-b9e68f296a12 service nova] Enqueued Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_members [ 611.330073] env[65553]: INFO networking_nsxv3.common.synchronization [req-6f8894df-b443-41b2-8e5c-392fffa862ac req-18767720-6a02-4e6f-af05-b9e68f296a12 service nova] Enqueued Resource ID: ddd60594-31d1-4213-8ed1-19ff2db18489 with Priority: HIGHEST for action port [ 611.330073] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_rules [ 611.330073] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_members [ 611.330266] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd60594-31d1-4213-8ed1-19ff2db18489 with Priority: HIGHEST for action port [ 611.330571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.330700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.330788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.331010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.331143] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec66a418-d823-4b2f-87e2-c61e09ea9de4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.334257] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec66a418-d823-4b2f-87e2-c61e09ea9de4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.334257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.334257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.334257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.334257] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.334257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.334257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.334257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.334257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.334257] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec66a418-d823-4b2f-87e2-c61e09ea9de4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.336480] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd60594-31d1-4213-8ed1-19ff2db18489 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.336663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd60594-31d1-4213-8ed1-19ff2db18489" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.336785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd60594-31d1-4213-8ed1-19ff2db18489" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.337103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd60594-31d1-4213-8ed1-19ff2db18489" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.337225] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd60594-31d1-4213-8ed1-19ff2db18489',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.402241] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d54328c-d1b5-49c2-8d50-fd614ccd99e4 [ 611.402241] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.402241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.402241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.402499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.402634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.402926] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d54328c-d1b5-49c2-8d50-fd614ccd99e4 already deleted. [ 611.402926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d54328c-d1b5-49c2-8d50-fd614ccd99e4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.626156] env[65553]: INFO networking_nsxv3.common.synchronization [req-48cb0a4d-8bd1-4c5a-af0d-95e8a6045239 req-3ea8315e-0b94-422d-b7da-978e5a30eed9 tempest-ImagesNegativeTestJSON-419708667 tempest-ImagesNegativeTestJSON-419708667-project-member] Enqueued Resource ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 with Priority: HIGHEST for action security_group_members [ 611.626517] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 with Priority: HIGHEST for action security_group_members [ 611.627172] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ed7e07-211b-423b-917e-bf729b9b3c70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.627172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.627172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.627350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.627708] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.627779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.627812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.627997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.628483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.628572] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45ed7e07-211b-423b-917e-bf729b9b3c70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.666418] env[65553]: INFO networking_nsxv3.common.synchronization [None req-49731d90-e0e5-43a5-922a-1d6294ce46cf None None] Enqueued Resource ID: d22fced5-184e-4562-8aa0-8b52568f29d3 with Priority: HIGHEST for action port [ 611.667881] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d22fced5-184e-4562-8aa0-8b52568f29d3 with Priority: HIGHEST for action port [ 611.667881] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d22fced5-184e-4562-8aa0-8b52568f29d3 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.667881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d22fced5-184e-4562-8aa0-8b52568f29d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.667881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d22fced5-184e-4562-8aa0-8b52568f29d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.667881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d22fced5-184e-4562-8aa0-8b52568f29d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.668422] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d22fced5-184e-4562-8aa0-8b52568f29d3',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.840252] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec66a418-d823-4b2f-87e2-c61e09ea9de4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.840252] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec66a418-d823-4b2f-87e2-c61e09ea9de4 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.840536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.840713] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddd60594-31d1-4213-8ed1-19ff2db18489 with status ACTIVE [ 611.840877] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.840978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.841078] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.841270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.841355] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.841600] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.841897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.841897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.842185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.842265] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.842499] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.842610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.842677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.842803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.842875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.842963] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddd60594-31d1-4213-8ed1-19ff2db18489 is going to be updated. [ 611.868975] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.869456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.869456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.869616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.869740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.869972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd60594-31d1-4213-8ed1-19ff2db18489" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.020232] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-562 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.020482] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-562" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.020625] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-562" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.020991] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-562" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.021386] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.021612] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.021770] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.022140] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.022364] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.022666] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.022826] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.023358] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.023358] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.023358] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.023358] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.023600] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.050213] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.050213] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.050213] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.050213] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-562" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.050417] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-0454c18f-9234-4c87-8bd4-556028ce25bf taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.050417] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-0454c18f-9234-4c87-8bd4-556028ce25bf" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.050559] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-0454c18f-9234-4c87-8bd4-556028ce25bf" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.050968] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-0454c18f-9234-4c87-8bd4-556028ce25bf" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.051085] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0454c18f-9234-4c87-8bd4-556028ce25bf',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.131471] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.131673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.132297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.132297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.132297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.132441] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.132441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.132528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.133127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.133127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.133127] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 already deleted. [ 612.133127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.171556] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d22fced5-184e-4562-8aa0-8b52568f29d3 [ 612.171808] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.171956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.172082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.172313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.173024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.173024] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d22fced5-184e-4562-8aa0-8b52568f29d3 already deleted. [ 612.173024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d22fced5-184e-4562-8aa0-8b52568f29d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.209100] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 612.209335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.210306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.210306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.210306] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.342996] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec66a418-d823-4b2f-87e2-c61e09ea9de4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.514827] env[65553]: INFO networking_nsxv3.common.synchronization [None req-919afd8f-b34a-49c0-a6e4-656337b246cc tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_rules [ 612.516234] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_rules [ 612.516472] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.516680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.516804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.517274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.517394] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.553704] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.553975] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.554115] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.554353] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.554492] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.554642] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 0454c18f-9234-4c87-8bd4-556028ce25bf not found, creating... [ 612.556396] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.556396] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.556396] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.556396] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.556396] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.556396] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.556396] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.556396] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.556396] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.557255] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.557255] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 0454c18f-9234-4c87-8bd4-556028ce25bf is going to be created. [ 612.583806] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.586106] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.586106] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.586106] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.586106] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.586106] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-0454c18f-9234-4c87-8bd4-556028ce25bf" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.712636] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.713462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.793371] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d63d25b6-e742-4953-a8d9-180dff842e87 tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_rules [ 612.794928] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_rules [ 612.796709] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.796834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.845557] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.845722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.845854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.846028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.846133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.846269] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 is going to be created. [ 612.876871] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.876871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.876871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.876871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.876871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.889993] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 in Status: UNINITIALIZED for 2s [ 613.044323] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.044519] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.044561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.044949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.044949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.045252] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 already deleted. [ 613.045252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.045451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.045837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.045837] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.140394] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 613.140608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.141089] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.141314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.141506] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.141721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.141864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.142050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.142176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.142301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.142422] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.382651] env[65553]: INFO networking_nsxv3.common.synchronization [req-48cb0a4d-8bd1-4c5a-af0d-95e8a6045239 req-186ad406-808b-4a24-8586-1b5905d6eafb service nova] Enqueued Resource ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 with Priority: HIGHEST for action security_group_rules [ 613.382651] env[65553]: INFO networking_nsxv3.common.synchronization [req-48cb0a4d-8bd1-4c5a-af0d-95e8a6045239 req-186ad406-808b-4a24-8586-1b5905d6eafb service nova] Enqueued Resource ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 with Priority: HIGHEST for action security_group_members [ 613.382651] env[65553]: INFO networking_nsxv3.common.synchronization [req-48cb0a4d-8bd1-4c5a-af0d-95e8a6045239 req-186ad406-808b-4a24-8586-1b5905d6eafb service nova] Enqueued Resource ID: 0454c18f-9234-4c87-8bd4-556028ce25bf with Priority: HIGHEST for action port [ 613.382957] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 with Priority: HIGHEST for action security_group_rules [ 613.385173] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 with Priority: HIGHEST for action security_group_members [ 613.385342] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0454c18f-9234-4c87-8bd4-556028ce25bf with Priority: HIGHEST for action port [ 613.387723] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45ed7e07-211b-423b-917e-bf729b9b3c70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.387723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.387723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.387723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.387723] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45ed7e07-211b-423b-917e-bf729b9b3c70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.388911] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ed7e07-211b-423b-917e-bf729b9b3c70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.392114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.392114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.392114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.392114] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.392114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.392114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.392114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.392114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.392114] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45ed7e07-211b-423b-917e-bf729b9b3c70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.392114] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-0454c18f-9234-4c87-8bd4-556028ce25bf taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.392114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0454c18f-9234-4c87-8bd4-556028ce25bf" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.392114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0454c18f-9234-4c87-8bd4-556028ce25bf" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.392114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0454c18f-9234-4c87-8bd4-556028ce25bf" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.392114] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0454c18f-9234-4c87-8bd4-556028ce25bf',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.577262] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.577426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.577535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.577764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.577860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.577981] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 already deleted. [ 613.578173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.644301] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.644485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.644580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.644932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.645131] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.645262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.645337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.646260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.646395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.646496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.646658] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.646763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.646988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.646988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.647138] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.647230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.647289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.647436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.647534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.647625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.647715] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.893545] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ed7e07-211b-423b-917e-bf729b9b3c70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.894071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.894071] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45ed7e07-211b-423b-917e-bf729b9b3c70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.894857] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0454c18f-9234-4c87-8bd4-556028ce25bf with status ACTIVE [ 613.895072] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.895208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.895278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.895484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.895576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.895752] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.895868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.895930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.896092] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.896171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.896362] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.896484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.896484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.896632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.896698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.896829] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0454c18f-9234-4c87-8bd4-556028ce25bf is going to be updated. [ 613.926300] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.926578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.926578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.927132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.927132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.927132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0454c18f-9234-4c87-8bd4-556028ce25bf" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.152655] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb: rpc.has_security_group_logging(os_id): False [ 614.176756] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.176864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.177168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.178257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.178364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.179196] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.179196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.179196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.179196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.179196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.179394] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.179394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.179475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.179613] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.179686] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.179879] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.179973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.180040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.180203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.180314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.180612] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be updated. [ 614.285020] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.285020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.285020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.285020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.285020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.287823] env[65553]: INFO networking_nsxv3.common.synchronization [req-e5ef0107-bf5c-456e-a133-c8c6b5d27014 req-a726ea19-5860-4d9e-874f-41cafacbfb5a tempest-TenantUsagesTestJSON-69369519 tempest-TenantUsagesTestJSON-69369519-project-member] Enqueued Resource ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae with Priority: HIGHEST for action security_group_members [ 614.288861] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae with Priority: HIGHEST for action security_group_members [ 614.289285] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.289717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.289717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.291025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.291864] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.291997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.291997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.292716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.292716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.292716] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54d93d69-4c1f-45f9-bd84-41ef7facb6ae',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.306441] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: IN_PROGRESS for 2s [ 614.398716] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45ed7e07-211b-423b-917e-bf729b9b3c70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.607580] env[65553]: INFO networking_nsxv3.common.synchronization [req-1fe7b0a2-fa41-475a-a97e-f6b0769924a7 req-e22242dc-867d-4f98-b500-e162e4a36ca7 tempest-DeleteServersAdminTestJSON-282562066 tempest-DeleteServersAdminTestJSON-282562066-project-admin] Enqueued Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 614.608248] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 614.608564] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.608720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.608830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.608968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.609141] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.609259] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.609327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.609462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.609548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.609648] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.721020] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.721020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.721020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.721020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.721020] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.721020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.721020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.721020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.721020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.721020] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.721020] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.721020] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.721020] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.721549] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.721940] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.722304] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.745028] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.745028] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.745028] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.745028] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.745028] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-d5b03be8-e100-4dd1-b94f-689dd629ae6b taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.745028] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-d5b03be8-e100-4dd1-b94f-689dd629ae6b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.745028] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-d5b03be8-e100-4dd1-b94f-689dd629ae6b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.745028] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-d5b03be8-e100-4dd1-b94f-689dd629ae6b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.745925] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5b03be8-e100-4dd1-b94f-689dd629ae6b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.796431] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.796431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.796431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.796431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.796431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.796431] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.796431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.796431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.796431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.796431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.796431] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae already deleted. [ 614.796431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.901717] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 in Status: SUCCESS [ 614.902027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.902392] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.902526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.902596] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.902884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.902884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.902982] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 is going to be created. [ 614.904024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.904218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.904831] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.904966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.905107] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.905163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.905257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.906350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.906350] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec66a418-d823-4b2f-87e2-c61e09ea9de4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.933022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.933022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.933022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.933022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.933022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.943124] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 in Status: UNINITIALIZED for 2s [ 615.112731] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.112818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.112852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.113105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.113203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.113405] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.113506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.113567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.113719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.113793] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.113918] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 is going to be updated. [ 615.152026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.152026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.152026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.152026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.152026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.166248] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: IN_PROGRESS for 2s [ 615.248679] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.249193] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.249193] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.249494] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.249804] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.250138] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port d5b03be8-e100-4dd1-b94f-689dd629ae6b not found, creating... [ 615.250526] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.251156] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.251327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.251714] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.251970] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.252403] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.252649] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.252833] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.253168] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.253406] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.253709] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: d5b03be8-e100-4dd1-b94f-689dd629ae6b is going to be created. [ 615.282323] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.282682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.282804] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.283155] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.283424] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.283678] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-d5b03be8-e100-4dd1-b94f-689dd629ae6b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.408157] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec66a418-d823-4b2f-87e2-c61e09ea9de4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.910024] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec66a418-d823-4b2f-87e2-c61e09ea9de4: rpc.has_security_group_logging(os_id): False [ 615.930023] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.930023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.930023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.930023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.930023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.930023] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.930023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.930023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.930023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.930023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.930023] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 is going to be created. [ 615.968281] env[65553]: INFO networking_nsxv3.common.synchronization [req-e5ef0107-bf5c-456e-a133-c8c6b5d27014 req-600df6ad-0561-4eb6-813e-40c9c7a2e378 service nova] Enqueued Resource ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae with Priority: HIGHEST for action security_group_rules [ 615.968281] env[65553]: INFO networking_nsxv3.common.synchronization [req-e5ef0107-bf5c-456e-a133-c8c6b5d27014 req-600df6ad-0561-4eb6-813e-40c9c7a2e378 service nova] Enqueued Resource ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae with Priority: HIGHEST for action security_group_members [ 615.968281] env[65553]: INFO networking_nsxv3.common.synchronization [req-e5ef0107-bf5c-456e-a133-c8c6b5d27014 req-600df6ad-0561-4eb6-813e-40c9c7a2e378 service nova] Enqueued Resource ID: d5b03be8-e100-4dd1-b94f-689dd629ae6b with Priority: HIGHEST for action port [ 615.968281] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae with Priority: HIGHEST for action security_group_rules [ 615.968281] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae with Priority: HIGHEST for action security_group_members [ 615.968281] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b03be8-e100-4dd1-b94f-689dd629ae6b with Priority: HIGHEST for action port [ 615.968281] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54d93d69-4c1f-45f9-bd84-41ef7facb6ae taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.968281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.968281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.968281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.968281] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54d93d69-4c1f-45f9-bd84-41ef7facb6ae',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.969879] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.970160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.970363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.970644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.972068] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.972068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.972068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.972068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.972068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.972068] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54d93d69-4c1f-45f9-bd84-41ef7facb6ae',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.973588] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5b03be8-e100-4dd1-b94f-689dd629ae6b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.974076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5b03be8-e100-4dd1-b94f-689dd629ae6b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.974205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5b03be8-e100-4dd1-b94f-689dd629ae6b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.974461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5b03be8-e100-4dd1-b94f-689dd629ae6b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.975857] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5b03be8-e100-4dd1-b94f-689dd629ae6b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.988047] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.988047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.988047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.988047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.988047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.004037] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 in Status: IN_PROGRESS for 2s [ 616.321272] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 616.321489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.324137] env[65553]: INFO networking_nsxv3.common.synchronization [req-c5f5d66b-a195-4488-8818-95beaca58a75 req-1795d0d6-7a18-4538-8819-dfdf45cbdb19 tempest-AttachInterfacesV270Test-558104461 tempest-AttachInterfacesV270Test-558104461-project-member] Enqueued Resource ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 with Priority: HIGHEST for action security_group_members [ 616.324277] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 with Priority: HIGHEST for action security_group_members [ 616.324604] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-adbdb58c-5387-4b80-952f-8897a8d0f9c9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.324720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.324785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.325087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.325249] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.325365] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.325418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.325575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.325657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.325752] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adbdb58c-5387-4b80-952f-8897a8d0f9c9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.476841] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54d93d69-4c1f-45f9-bd84-41ef7facb6ae',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.478311] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.478534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.478956] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5b03be8-e100-4dd1-b94f-689dd629ae6b with status ACTIVE [ 616.479186] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.479343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.479402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.479614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.479717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.480162] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.480272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.480421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.480532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.480588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.480795] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.480869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.480917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.481052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.481166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.481346] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5b03be8-e100-4dd1-b94f-689dd629ae6b is going to be updated. [ 616.508491] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.508759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.508759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.508940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.509020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.509218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5b03be8-e100-4dd1-b94f-689dd629ae6b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.674509] env[65553]: INFO networking_nsxv3.common.synchronization [req-be159241-6753-4e37-b210-7ae3a00f00bc req-f090b71e-5963-4b41-8134-5af8f8628ff9 tempest-ServerDiagnosticsTest-1424423745 tempest-ServerDiagnosticsTest-1424423745-project-member] Enqueued Resource ID: 84881d5c-05c0-4bde-84e9-437b2da92669 with Priority: HIGHEST for action security_group_members [ 616.675566] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84881d5c-05c0-4bde-84e9-437b2da92669 with Priority: HIGHEST for action security_group_members [ 616.675737] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-84881d5c-05c0-4bde-84e9-437b2da92669 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.675832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.675892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.676142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.676328] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.676465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.676559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.676906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.676906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.677067] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84881d5c-05c0-4bde-84e9-437b2da92669',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.754808] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.754999] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.755147] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.755528] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.755790] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.755945] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.756081] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.756361] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.756508] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.756708] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.756810] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.756908] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.757079] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.757220] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.757327] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.757477] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.783678] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.783984] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.784065] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.784199] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-12" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.784517] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-465e7c3e-8ad2-4742-83c1-635c3e349902 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.784853] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-465e7c3e-8ad2-4742-83c1-635c3e349902" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.784853] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-465e7c3e-8ad2-4742-83c1-635c3e349902" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.785156] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-465e7c3e-8ad2-4742-83c1-635c3e349902" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.785292] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('465e7c3e-8ad2-4742-83c1-635c3e349902',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.827852] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.828049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.828125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.828376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.828472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.828672] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.828790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.829397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.829397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.829397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.829397] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 already deleted. [ 616.829397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.954123] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 in Status: SUCCESS [ 616.954432] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.955892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.955892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.955892] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.955892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.955892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.955892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.955892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.955892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.955892] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45ed7e07-211b-423b-917e-bf729b9b3c70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.983827] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54d93d69-4c1f-45f9-bd84-41ef7facb6ae',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.178819] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: SUCCESS [ 617.179053] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 deletion is rescheduled due to dependency. [ 617.179211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.179597] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.179737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.179797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.180044] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.180131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.180370] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.180492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.180554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.180687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.180763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.180832] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84881d5c-05c0-4bde-84e9-437b2da92669 is going to be updated. [ 617.219729] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.219945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.219979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.220312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.220486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.238331] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84881d5c-05c0-4bde-84e9-437b2da92669 in Status: IN_PROGRESS for 2s [ 617.288243] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.288548] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.288678] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.288985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.289191] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.289360] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 465e7c3e-8ad2-4742-83c1-635c3e349902 not found, creating... [ 617.289676] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.289869] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.290038] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.290326] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.290486] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.290825] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.290961] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.291089] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.291313] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.291463] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.291624] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 465e7c3e-8ad2-4742-83c1-635c3e349902 is going to be created. [ 617.326131] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.326431] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.326498] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.326927] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.327889] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.328246] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-465e7c3e-8ad2-4742-83c1-635c3e349902" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.459306] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ed7e07-211b-423b-917e-bf729b9b3c70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.459578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.459656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.459942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.460165] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.460271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.460385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.460505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.460630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.460746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.460908] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ed7e07-211b-423b-917e-bf729b9b3c70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.461070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.461163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.461329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.461488] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.461618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.461685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.462033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.462153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.462273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.462410] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45ed7e07-211b-423b-917e-bf729b9b3c70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.488286] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.488448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.488521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.488732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.488822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.488919] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae is going to be created. [ 617.524494] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.524494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.524494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.524494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.524494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.536507] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae in Status: UNINITIALIZED for 2s [ 617.656655] env[65553]: INFO networking_nsxv3.common.synchronization [None req-ee93eb90-692d-4553-9701-fe093b464bfb tempest-ServersWithSpecificFlavorTestJSON-819002853 tempest-ServersWithSpecificFlavorTestJSON-819002853-project-member] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_rules [ 617.657248] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_rules [ 617.658295] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.658490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.658490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.658820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.658899] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.775900] env[65553]: INFO networking_nsxv3.common.synchronization [None req-96f9ab6f-c04a-440c-84bc-b4ac7df70be2 tempest-ServersWithSpecificFlavorTestJSON-819002853 tempest-ServersWithSpecificFlavorTestJSON-819002853-project-member] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_rules [ 617.776565] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_rules [ 617.776920] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.777603] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.964720] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45ed7e07-211b-423b-917e-bf729b9b3c70: rpc.has_security_group_logging(os_id): False [ 617.985982] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.986284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.986404] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.986600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.986707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.986878] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.987025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.987123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.987268] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.987344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.987639] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.987780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.987844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.988070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.988198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.988485] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.988631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.988753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.988899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.988931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.989034] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 is going to be created. [ 618.027928] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 in Status: SUCCESS [ 618.028176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.042329] env[65553]: INFO networking_nsxv3.common.synchronization [req-c5f5d66b-a195-4488-8818-95beaca58a75 req-6881a525-0528-480a-b673-9d3420a3c9fa service nova] Enqueued Resource ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 with Priority: HIGHEST for action security_group_rules [ 618.042594] env[65553]: INFO networking_nsxv3.common.synchronization [req-c5f5d66b-a195-4488-8818-95beaca58a75 req-6881a525-0528-480a-b673-9d3420a3c9fa service nova] Enqueued Resource ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 with Priority: HIGHEST for action security_group_members [ 618.042674] env[65553]: INFO networking_nsxv3.common.synchronization [req-c5f5d66b-a195-4488-8818-95beaca58a75 req-6881a525-0528-480a-b673-9d3420a3c9fa service nova] Enqueued Resource ID: 465e7c3e-8ad2-4742-83c1-635c3e349902 with Priority: HIGHEST for action port [ 618.043145] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 with Priority: HIGHEST for action security_group_rules [ 618.043324] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 with Priority: HIGHEST for action security_group_members [ 618.043468] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 465e7c3e-8ad2-4742-83c1-635c3e349902 with Priority: HIGHEST for action port [ 618.043737] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adbdb58c-5387-4b80-952f-8897a8d0f9c9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.043930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.043930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.045930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.046448] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adbdb58c-5387-4b80-952f-8897a8d0f9c9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.049975] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-adbdb58c-5387-4b80-952f-8897a8d0f9c9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.050136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.050205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.050407] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.050596] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.051485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.052800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.052800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.052800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.052800] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adbdb58c-5387-4b80-952f-8897a8d0f9c9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.053059] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-465e7c3e-8ad2-4742-83c1-635c3e349902 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.053059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-465e7c3e-8ad2-4742-83c1-635c3e349902" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.053153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-465e7c3e-8ad2-4742-83c1-635c3e349902" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.053289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-465e7c3e-8ad2-4742-83c1-635c3e349902" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.053784] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('465e7c3e-8ad2-4742-83c1-635c3e349902',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.058899] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.059774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.061371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.061371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.061371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.072248] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 in Status: IN_PROGRESS for 2s [ 618.182336] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.182619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.182619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.182765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.182854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.182949] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a already deleted. [ 618.183049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.183274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.183438] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.183521] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.549573] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-adbdb58c-5387-4b80-952f-8897a8d0f9c9 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.549664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.557163] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 465e7c3e-8ad2-4742-83c1-635c3e349902 with status ACTIVE [ 618.557419] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.557557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.557626] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.557952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.557952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.558125] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.558231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.558324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.558485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.558567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.560353] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.560353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.560353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.560353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.560353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.560353] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 465e7c3e-8ad2-4742-83c1-635c3e349902 is going to be updated. [ 618.561615] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adbdb58c-5387-4b80-952f-8897a8d0f9c9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.589091] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.589327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.589402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.589768] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.590015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.590293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-465e7c3e-8ad2-4742-83c1-635c3e349902" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.664886] env[65553]: INFO networking_nsxv3.common.synchronization [req-857cdfe3-1775-433a-b587-7dcf459e33f2 req-1a011e75-2906-4666-96ad-fb6d4dbc6fdd tempest-ServerExternalEventsTest-672998774 tempest-ServerExternalEventsTest-672998774-project-member] Enqueued Resource ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c with Priority: HIGHEST for action security_group_members [ 618.666885] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c with Priority: HIGHEST for action security_group_members [ 618.667281] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3d9a09b-bf97-4de9-910d-f878fc6b267c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.667418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.667507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.667761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.667936] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.668070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.668121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.668277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.669111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.669111] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3d9a09b-bf97-4de9-910d-f878fc6b267c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.728458] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.728638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.728720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.729013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.730036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.730036] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a already deleted. [ 618.730036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.017325] env[65553]: INFO networking_nsxv3.common.synchronization [req-a21b09fb-4363-4069-8d5a-1c53bc29608c req-c641f502-0073-4c3a-8607-7213f3f17f8f tempest-VolumesAdminNegativeTest-424044938 tempest-VolumesAdminNegativeTest-424044938-project-member] Enqueued Resource ID: 47ac6222-df91-40b6-8703-f88ab52afe33 with Priority: HIGHEST for action security_group_members [ 619.017821] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ac6222-df91-40b6-8703-f88ab52afe33 with Priority: HIGHEST for action security_group_members [ 619.018131] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ac6222-df91-40b6-8703-f88ab52afe33 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.018267] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.018354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.018922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.019101] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.019205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.019271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.019433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.019519] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.020241] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ac6222-df91-40b6-8703-f88ab52afe33',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.066956] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adbdb58c-5387-4b80-952f-8897a8d0f9c9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.174095] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.174095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.174095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.174095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.174095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.174095] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.174095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.174095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.174095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.174095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.174095] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c is going to be updated. [ 619.206302] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.206540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.206540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.207339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.207339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.218794] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c in Status: IN_PROGRESS for 2s [ 619.250928] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84881d5c-05c0-4bde-84e9-437b2da92669 in Status: SUCCESS [ 619.251120] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84881d5c-05c0-4bde-84e9-437b2da92669 deletion is rescheduled due to dependency. [ 619.251255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.374139] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.374350] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-173" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.374468] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-173" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.374795] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-173" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.375117] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.375285] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.375399] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.375621] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.375760] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.375986] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.376078] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.376181] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.376281] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.376382] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.376480] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.376605] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.401916] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.402069] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.402187] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.402370] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-173" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.402709] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-f1de8737-226f-4d38-a733-3932f1119ff3 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.402883] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-f1de8737-226f-4d38-a733-3932f1119ff3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.402997] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-f1de8737-226f-4d38-a733-3932f1119ff3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.403422] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-f1de8737-226f-4d38-a733-3932f1119ff3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.403582] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1de8737-226f-4d38-a733-3932f1119ff3',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.522507] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.522507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.522507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.522507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.522507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.522809] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.522809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.522893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.522995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.523080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.523161] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ac6222-df91-40b6-8703-f88ab52afe33 already deleted. [ 619.523237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.547995] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae in Status: SUCCESS [ 619.548316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.548517] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.548926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.548926] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.549087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.549128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.549311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.549432] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.549554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.549651] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54d93d69-4c1f-45f9-bd84-41ef7facb6ae',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.571022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.571022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.571022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.571022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.571022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.571022] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 is going to be created. [ 619.595667] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.595843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.595917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.596160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.596362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.614694] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 in Status: UNINITIALIZED for 2s [ 619.909660] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.909660] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.909660] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.909660] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.909980] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.909980] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port f1de8737-226f-4d38-a733-3932f1119ff3 not found, creating... [ 619.910672] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.910672] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.910672] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.910867] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.911055] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.912092] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.912092] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.912092] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.912092] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.912092] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.912329] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: f1de8737-226f-4d38-a733-3932f1119ff3 is going to be created. [ 619.936809] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.937112] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.937325] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.937721] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.938043] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.938288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-f1de8737-226f-4d38-a733-3932f1119ff3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.055816] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.055816] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.055816] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.055816] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.055816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.056721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.056721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.056721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.056721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.056721] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54d93d69-4c1f-45f9-bd84-41ef7facb6ae',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.086870] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 in Status: SUCCESS [ 620.087468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.330809] env[65553]: INFO networking_nsxv3.common.synchronization [req-5a77f625-8675-411e-a72c-55ea4b6c4148 req-36821cd0-7368-4b69-b96d-0efbd63e01e0 tempest-ServerPasswordTestJSON-1282297697 tempest-ServerPasswordTestJSON-1282297697-project-member] Enqueued Resource ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f with Priority: HIGHEST for action security_group_members [ 620.331961] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f with Priority: HIGHEST for action security_group_members [ 620.332538] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad458bc8-8a48-49a7-9f97-e510476fdf4f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.332815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.333012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.333320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.333550] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.333761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.333946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.334202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.334403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.334613] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad458bc8-8a48-49a7-9f97-e510476fdf4f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.561435] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54d93d69-4c1f-45f9-bd84-41ef7facb6ae: rpc.has_security_group_logging(os_id): False [ 620.587413] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.587609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.587609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.587844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.588068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.588207] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.588303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.588367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.588551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.588646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.588917] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.589036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.589036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.589213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.589292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.589479] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.589586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.589644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.589816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.589896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.589990] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae is going to be created. [ 620.671148] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.671284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.671355] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.671581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.672086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.687950] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae in Status: IN_PROGRESS for 2s [ 620.707779] env[65553]: INFO networking_nsxv3.common.synchronization [req-a21b09fb-4363-4069-8d5a-1c53bc29608c req-1ea81fbe-2f62-4ac5-b162-9a7b21f12dbc service nova] Enqueued Resource ID: 47ac6222-df91-40b6-8703-f88ab52afe33 with Priority: HIGHEST for action security_group_rules [ 620.707779] env[65553]: INFO networking_nsxv3.common.synchronization [req-a21b09fb-4363-4069-8d5a-1c53bc29608c req-1ea81fbe-2f62-4ac5-b162-9a7b21f12dbc service nova] Enqueued Resource ID: 47ac6222-df91-40b6-8703-f88ab52afe33 with Priority: HIGHEST for action security_group_members [ 620.707779] env[65553]: INFO networking_nsxv3.common.synchronization [req-a21b09fb-4363-4069-8d5a-1c53bc29608c req-1ea81fbe-2f62-4ac5-b162-9a7b21f12dbc service nova] Enqueued Resource ID: f1de8737-226f-4d38-a733-3932f1119ff3 with Priority: HIGHEST for action port [ 620.707779] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ac6222-df91-40b6-8703-f88ab52afe33 with Priority: HIGHEST for action security_group_rules [ 620.707779] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ac6222-df91-40b6-8703-f88ab52afe33 with Priority: HIGHEST for action security_group_members [ 620.708016] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1de8737-226f-4d38-a733-3932f1119ff3 with Priority: HIGHEST for action port [ 620.708216] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ac6222-df91-40b6-8703-f88ab52afe33 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.708336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.708400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.708718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.708879] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ac6222-df91-40b6-8703-f88ab52afe33',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.710044] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ac6222-df91-40b6-8703-f88ab52afe33 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.710676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.710676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.710676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.710676] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.710876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.710876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.710952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.711077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.711176] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ac6222-df91-40b6-8703-f88ab52afe33',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.713052] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1de8737-226f-4d38-a733-3932f1119ff3 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.713052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1de8737-226f-4d38-a733-3932f1119ff3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.713052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1de8737-226f-4d38-a733-3932f1119ff3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.713348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1de8737-226f-4d38-a733-3932f1119ff3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.713348] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1de8737-226f-4d38-a733-3932f1119ff3',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.838166] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.838417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.838417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.838615] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.840160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.840160] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.840160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.840160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.840160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.840160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.840160] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f is going to be updated. [ 620.879093] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.879484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.879689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.879995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.880244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.894985] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f in Status: IN_PROGRESS for 2s [ 621.216186] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ac6222-df91-40b6-8703-f88ab52afe33 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.216186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.216186] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47ac6222-df91-40b6-8703-f88ab52afe33',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.217053] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1de8737-226f-4d38-a733-3932f1119ff3 with status ACTIVE [ 621.217260] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.217454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.217521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.217788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.217888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.219964] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.219964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.219964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.219964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.219964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.219964] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.219964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.219964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.219964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.219964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.219964] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1de8737-226f-4d38-a733-3932f1119ff3 is going to be updated. [ 621.238270] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c in Status: SUCCESS [ 621.238537] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3d9a09b-bf97-4de9-910d-f878fc6b267c deletion is rescheduled due to dependency. [ 621.238717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3d9a09b-bf97-4de9-910d-f878fc6b267c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.251215] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.252727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.252727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.252904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.253114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.253290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1de8737-226f-4d38-a733-3932f1119ff3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.625678] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 in Status: SUCCESS [ 621.625678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.625788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.626250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.626976] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.627161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.627241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.627748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.627799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.627997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.628126] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adbdb58c-5387-4b80-952f-8897a8d0f9c9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.723036] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47ac6222-df91-40b6-8703-f88ab52afe33',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.131758] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-adbdb58c-5387-4b80-952f-8897a8d0f9c9 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.132046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.132101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.132355] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.132542] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.132655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.132719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.134333] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-adbdb58c-5387-4b80-952f-8897a8d0f9c9 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.134333] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.134333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.134333] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adbdb58c-5387-4b80-952f-8897a8d0f9c9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.227264] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.227551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.227551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.227873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.228029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.228269] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ac6222-df91-40b6-8703-f88ab52afe33 is going to be created. [ 622.258658] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.258846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.258903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.259123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.259282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.270846] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ac6222-df91-40b6-8703-f88ab52afe33 in Status: UNINITIALIZED for 2s [ 622.640034] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adbdb58c-5387-4b80-952f-8897a8d0f9c9: rpc.has_security_group_logging(os_id): False [ 622.663150] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.663564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.663564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.663841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.663841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.664049] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.664534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.664534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.664534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.664534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.664779] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.664854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.664929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.666031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.666142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.668884] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.668884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.668884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.668884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.668884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.668884] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 is going to be created. [ 622.705903] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae in Status: SUCCESS [ 622.705903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.745459] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.745648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.745745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.748765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.748765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.766929] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 in Status: IN_PROGRESS for 2s [ 622.911621] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f in Status: SUCCESS [ 622.911621] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad458bc8-8a48-49a7-9f97-e510476fdf4f deletion is rescheduled due to dependency. [ 622.911621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad458bc8-8a48-49a7-9f97-e510476fdf4f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.283918] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ac6222-df91-40b6-8703-f88ab52afe33 in Status: SUCCESS [ 624.284398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.284527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.284807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.284981] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.285713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.285713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.285713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.285713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.285713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.285713] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47ac6222-df91-40b6-8703-f88ab52afe33',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.782152] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 in Status: SUCCESS [ 624.782390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.787956] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ac6222-df91-40b6-8703-f88ab52afe33 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.788278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.788379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.788659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.788778] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.788883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.788940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.789110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.789197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.789282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.789429] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ac6222-df91-40b6-8703-f88ab52afe33 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.789522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.789585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.789721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.789857] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.789948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.789999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.790156] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.790228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.790309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.790397] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47ac6222-df91-40b6-8703-f88ab52afe33',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.294534] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47ac6222-df91-40b6-8703-f88ab52afe33: rpc.has_security_group_logging(os_id): False [ 625.320676] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.321081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.321257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.321894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.321999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.322240] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.322390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.322455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.322917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.322917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.323123] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.323239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.323304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.323470] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.323548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.323740] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.323855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.323943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.324137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.324289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.324440] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ac6222-df91-40b6-8703-f88ab52afe33 is going to be created. [ 625.415511] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.415910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.416033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.416208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.416576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.435032] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ac6222-df91-40b6-8703-f88ab52afe33 in Status: IN_PROGRESS for 2s [ 625.709166] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 625.709166] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 625.970738] env[65553]: INFO networking_nsxv3.common.synchronization [req-b138bce6-9d13-4eae-8079-9478f0540a06 req-34f6344d-c44c-4628-b469-f100811f4a58 tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 625.971318] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 625.972034] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.972034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.972034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.972373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.972600] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.972768] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.972861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.973067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.973182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.973300] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.408899] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.409264] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.409264] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.409804] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.410079] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.410244] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.410361] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.410564] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.410700] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.410896] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.411009] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.411114] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.411212] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.411313] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.411410] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.411529] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.431343] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.431802] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.432033] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.432265] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.432792] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-f219da95-f490-4b6f-95b7-91f4fd99f1a4 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.433069] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-f219da95-f490-4b6f-95b7-91f4fd99f1a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.433247] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-f219da95-f490-4b6f-95b7-91f4fd99f1a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.434338] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-f219da95-f490-4b6f-95b7-91f4fd99f1a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.434338] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f219da95-f490-4b6f-95b7-91f4fd99f1a4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.477340] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.477340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.477340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.477656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.477693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.478688] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.478688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.478688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.478688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.478688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.478688] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 already deleted. [ 626.478688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.937291] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.938210] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.938210] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.938210] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.938387] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.938536] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port f219da95-f490-4b6f-95b7-91f4fd99f1a4 not found, creating... [ 626.938946] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.939162] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.939311] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.939993] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.939993] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.940247] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.940411] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.940572] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.940800] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.940945] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.941109] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: f219da95-f490-4b6f-95b7-91f4fd99f1a4 is going to be created. [ 626.967682] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.967682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.967682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.967682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.967682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.967969] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-f219da95-f490-4b6f-95b7-91f4fd99f1a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.449325] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47ac6222-df91-40b6-8703-f88ab52afe33 in Status: SUCCESS [ 627.449325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.719733] env[65553]: INFO networking_nsxv3.common.synchronization [req-b138bce6-9d13-4eae-8079-9478f0540a06 req-396fe60f-c024-4252-8865-da93f2531088 service nova] Enqueued Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_rules [ 627.719733] env[65553]: INFO networking_nsxv3.common.synchronization [req-b138bce6-9d13-4eae-8079-9478f0540a06 req-396fe60f-c024-4252-8865-da93f2531088 service nova] Enqueued Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 627.719733] env[65553]: INFO networking_nsxv3.common.synchronization [req-b138bce6-9d13-4eae-8079-9478f0540a06 req-396fe60f-c024-4252-8865-da93f2531088 service nova] Enqueued Resource ID: f219da95-f490-4b6f-95b7-91f4fd99f1a4 with Priority: HIGHEST for action port [ 627.719733] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_rules [ 627.719733] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 627.719733] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f219da95-f490-4b6f-95b7-91f4fd99f1a4 with Priority: HIGHEST for action port [ 627.720173] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.720259] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.720350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.720619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.720751] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.723433] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.724026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.724139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.724461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.724860] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.725337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.725337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.725522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.725672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.725811] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.727197] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-f219da95-f490-4b6f-95b7-91f4fd99f1a4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.727747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f219da95-f490-4b6f-95b7-91f4fd99f1a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.727866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f219da95-f490-4b6f-95b7-91f4fd99f1a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.728109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f219da95-f490-4b6f-95b7-91f4fd99f1a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.729494] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f219da95-f490-4b6f-95b7-91f4fd99f1a4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.733142] env[65553]: INFO networking_nsxv3.common.synchronization [req-305f816f-1bd4-488e-b856-cc2281487f58 req-9f79c42c-d848-4263-b88a-0c9706154a3e tempest-ImagesNegativeTestJSON-419708667 tempest-ImagesNegativeTestJSON-419708667-project-member] Enqueued Resource ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 with Priority: HIGHEST for action security_group_members [ 627.733354] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 with Priority: HIGHEST for action security_group_members [ 627.734654] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-45ed7e07-211b-423b-917e-bf729b9b3c70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.734654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.734654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.734654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.734654] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.734654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.734654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.734654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.734654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.737835] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45ed7e07-211b-423b-917e-bf729b9b3c70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.225154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.225411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.230947] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.234287] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f219da95-f490-4b6f-95b7-91f4fd99f1a4 with status ACTIVE [ 628.235783] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.235783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.235783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.235783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.235783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.236166] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.236166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.236166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.236288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.236329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.236638] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.236769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.236769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.236882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.237163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.237163] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f219da95-f490-4b6f-95b7-91f4fd99f1a4 is going to be updated. [ 628.240760] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.241067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.241180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.242082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.242082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.242304] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.242403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.242403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.242594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.242722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.242907] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 is going to be updated. [ 628.271042] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.271442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.271442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.271660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.271660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.272206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f219da95-f490-4b6f-95b7-91f4fd99f1a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.280312] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.280312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.280312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.280312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.280594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.293616] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 in Status: IN_PROGRESS for 2s [ 628.733622] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.239468] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.239663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.239714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.240110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.240110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.240110] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 is going to be created. [ 629.268671] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.268849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.269193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.269450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.269637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.294388] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: UNINITIALIZED for 2s [ 629.702196] env[65553]: INFO networking_nsxv3.common.synchronization [None req-8107db25-b098-4166-879d-23b58830c59b None None] Enqueued Resource ID: 805f53fe-4a23-4d89-8e44-11637f8aa223 with Priority: HIGHEST for action port [ 629.702417] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 805f53fe-4a23-4d89-8e44-11637f8aa223 with Priority: HIGHEST for action port [ 629.702994] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-805f53fe-4a23-4d89-8e44-11637f8aa223 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.703364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-805f53fe-4a23-4d89-8e44-11637f8aa223" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.703364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-805f53fe-4a23-4d89-8e44-11637f8aa223" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.703490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-805f53fe-4a23-4d89-8e44-11637f8aa223" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.703603] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('805f53fe-4a23-4d89-8e44-11637f8aa223',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.205582] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 805f53fe-4a23-4d89-8e44-11637f8aa223 [ 630.206046] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.206507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.206803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.207139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.208333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.209026] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:805f53fe-4a23-4d89-8e44-11637f8aa223 already deleted. [ 630.209026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-805f53fe-4a23-4d89-8e44-11637f8aa223" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.305208] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 in Status: SUCCESS [ 630.305454] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 deletion is rescheduled due to dependency. [ 630.305454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.305893] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: SUCCESS [ 631.306388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.306388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.306601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.306700] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.306825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.306898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.307064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.307263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.307413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.307413] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.727496] env[65553]: INFO networking_nsxv3.common.synchronization [req-cfb87db2-3db9-4506-868d-6d796eba8b30 req-ed962eb7-0442-479f-b849-a0e1dd119558 tempest-ServersWithSpecificFlavorTestJSON-819002853 tempest-ServersWithSpecificFlavorTestJSON-819002853-project-member] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 631.727992] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 631.728380] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.730193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.730193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.730320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.730422] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.730551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.730608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.731481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.731612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.731718] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.810303] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.151138] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.151338] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-281" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.151456] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-281" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.151788] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-281" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.152470] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.152602] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.152914] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.153018] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.153156] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.153425] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.153582] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.153642] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.153728] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.153835] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.153933] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.154109] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.175733] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.176093] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.176381] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.176646] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-281" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.177142] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-e4185bf6-ffba-4a4e-b922-fb537b7bfa28 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.177417] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-e4185bf6-ffba-4a4e-b922-fb537b7bfa28" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.177607] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-e4185bf6-ffba-4a4e-b922-fb537b7bfa28" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.178077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-e4185bf6-ffba-4a4e-b922-fb537b7bfa28" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.178294] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4185bf6-ffba-4a4e-b922-fb537b7bfa28',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.234438] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.234679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.234679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.235455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.235455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.235455] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.235455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.235455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.235455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.235884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.235884] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a already deleted. [ 632.235884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.313771] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7: rpc.has_security_group_logging(os_id): False [ 632.336878] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.337153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.337233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.337479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.337573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.337949] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.338340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.338418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.338597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.338682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.338774] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 is going to be created. [ 632.399250] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.399424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.399494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.399712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.399942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.412835] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: IN_PROGRESS for 2s [ 632.683503] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.683503] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.683503] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.683503] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.683503] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.683503] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port e4185bf6-ffba-4a4e-b922-fb537b7bfa28 not found, creating... [ 632.683503] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.683975] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.683975] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.684113] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.684256] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.684626] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.684837] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.684984] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.685275] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.685428] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.685845] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: e4185bf6-ffba-4a4e-b922-fb537b7bfa28 is going to be created. [ 632.712356] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.712703] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.712843] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.713267] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.713663] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.713947] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-e4185bf6-ffba-4a4e-b922-fb537b7bfa28" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.812649] env[65553]: INFO networking_nsxv3.common.synchronization [None req-9e3976a5-1ac2-4632-bc6c-339a42be45f6 None None] Enqueued Resource ID: 1f3688a5-a6ef-4337-87eb-2074e993df89 with Priority: HIGHEST for action port [ 632.813220] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3688a5-a6ef-4337-87eb-2074e993df89 with Priority: HIGHEST for action port [ 632.813625] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f3688a5-a6ef-4337-87eb-2074e993df89 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.813807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f3688a5-a6ef-4337-87eb-2074e993df89" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.813896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f3688a5-a6ef-4337-87eb-2074e993df89" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.814227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f3688a5-a6ef-4337-87eb-2074e993df89" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.814317] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f3688a5-a6ef-4337-87eb-2074e993df89',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.317565] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f3688a5-a6ef-4337-87eb-2074e993df89 [ 633.319840] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.319840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.319840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.319840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.319840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.319840] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f3688a5-a6ef-4337-87eb-2074e993df89 already deleted. [ 633.319840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f3688a5-a6ef-4337-87eb-2074e993df89" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.446910] env[65553]: INFO networking_nsxv3.common.synchronization [req-cfb87db2-3db9-4506-868d-6d796eba8b30 req-5f7229c5-4742-4e94-b778-ecb6d6ebfef3 service nova] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_rules [ 633.446910] env[65553]: INFO networking_nsxv3.common.synchronization [req-cfb87db2-3db9-4506-868d-6d796eba8b30 req-5f7229c5-4742-4e94-b778-ecb6d6ebfef3 service nova] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 633.446910] env[65553]: INFO networking_nsxv3.common.synchronization [req-cfb87db2-3db9-4506-868d-6d796eba8b30 req-5f7229c5-4742-4e94-b778-ecb6d6ebfef3 service nova] Enqueued Resource ID: e4185bf6-ffba-4a4e-b922-fb537b7bfa28 with Priority: HIGHEST for action port [ 633.447113] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_rules [ 633.447787] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 633.447787] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4185bf6-ffba-4a4e-b922-fb537b7bfa28 with Priority: HIGHEST for action port [ 633.448016] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.448102] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.448177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.448387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.448468] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.449619] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.449619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.449619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.449789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.449845] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.449938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.449997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.450169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.450257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.452513] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.452513] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4185bf6-ffba-4a4e-b922-fb537b7bfa28 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.452513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4185bf6-ffba-4a4e-b922-fb537b7bfa28" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.452513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4185bf6-ffba-4a4e-b922-fb537b7bfa28" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.452513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4185bf6-ffba-4a4e-b922-fb537b7bfa28" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.452513] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4185bf6-ffba-4a4e-b922-fb537b7bfa28',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.953078] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.953306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.954743] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.955958] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4185bf6-ffba-4a4e-b922-fb537b7bfa28 with status ACTIVE [ 633.956101] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.956217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.956273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.956496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.956615] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.956776] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.956872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.956932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.957184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.957272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.957459] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.957553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.957611] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.957757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.957832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.957918] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4185bf6-ffba-4a4e-b922-fb537b7bfa28 is going to be updated. [ 633.988140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.988403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.988403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.988714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.988938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.989215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4185bf6-ffba-4a4e-b922-fb537b7bfa28" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.098021] env[65553]: INFO networking_nsxv3.common.synchronization [req-b26167cb-29a0-449a-beb8-8323a28cd473 req-91df3dc1-f8cf-4381-acf2-00e0a452d8f9 tempest-DeleteServersAdminTestJSON-651714207 tempest-DeleteServersAdminTestJSON-651714207-project-member] Enqueued Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 634.100569] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 634.101114] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.101841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.101841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.102136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.102770] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.103042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.103178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.103454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.103617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.104462] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.328673] env[65553]: INFO networking_nsxv3.common.synchronization [None req-df8ccf4e-854f-4a75-b153-9c83dd4ebf47 None None] Enqueued Resource ID: 3b1db9d9-7040-4b00-8276-28f8473fd2da with Priority: HIGHEST for action port [ 634.329330] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b1db9d9-7040-4b00-8276-28f8473fd2da with Priority: HIGHEST for action port [ 634.329647] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b1db9d9-7040-4b00-8276-28f8473fd2da taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.329950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b1db9d9-7040-4b00-8276-28f8473fd2da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.329950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b1db9d9-7040-4b00-8276-28f8473fd2da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.330360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b1db9d9-7040-4b00-8276-28f8473fd2da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.330360] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b1db9d9-7040-4b00-8276-28f8473fd2da',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.427989] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: SUCCESS [ 634.429108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.461812] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.503962] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.504236] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.504973] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.504973] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.504973] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.504973] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.504973] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.506132] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.506275] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.506549] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.506743] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.506940] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.507147] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.507331] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.508047] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.508047] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.529678] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.530031] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.530267] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.530515] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.530932] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-b27a1bae-0696-4427-b580-ec137f849153 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.531134] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-b27a1bae-0696-4427-b580-ec137f849153" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.531254] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-b27a1bae-0696-4427-b580-ec137f849153" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.531575] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-b27a1bae-0696-4427-b580-ec137f849153" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.531705] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b27a1bae-0696-4427-b580-ec137f849153',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.607826] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.608073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.608204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.608370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.608473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.608706] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.608855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.608925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.609086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.609159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.609269] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 is going to be updated. [ 634.646874] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.647064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.647132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.647343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.647482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.659443] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: IN_PROGRESS for 2s [ 634.835979] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b1db9d9-7040-4b00-8276-28f8473fd2da [ 634.836168] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.836315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.836433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.836653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.836744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.836867] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b1db9d9-7040-4b00-8276-28f8473fd2da already deleted. [ 634.836913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b1db9d9-7040-4b00-8276-28f8473fd2da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.965563] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.966451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.966451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.966451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.966451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.966451] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a is going to be created. [ 635.007464] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.007585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.007644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.007903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.008093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.026757] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: UNINITIALIZED for 2s [ 635.037276] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.037276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.037276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.037276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.037276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.037276] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port b27a1bae-0696-4427-b580-ec137f849153 not found, creating... [ 635.037276] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.037276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.037276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.038214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.038631] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.039360] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.040433] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.040433] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.040695] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.041029] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.041337] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: b27a1bae-0696-4427-b580-ec137f849153 is going to be created. [ 635.080606] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.081701] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.082902] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.083524] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.086694] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.086694] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-b27a1bae-0696-4427-b580-ec137f849153" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.842951] env[65553]: INFO networking_nsxv3.common.synchronization [req-b26167cb-29a0-449a-beb8-8323a28cd473 req-e9be2b9d-5473-4826-8896-35f3b3728d61 service nova] Enqueued Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_rules [ 635.842951] env[65553]: INFO networking_nsxv3.common.synchronization [req-b26167cb-29a0-449a-beb8-8323a28cd473 req-e9be2b9d-5473-4826-8896-35f3b3728d61 service nova] Enqueued Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 635.842951] env[65553]: INFO networking_nsxv3.common.synchronization [req-b26167cb-29a0-449a-beb8-8323a28cd473 req-e9be2b9d-5473-4826-8896-35f3b3728d61 service nova] Enqueued Resource ID: b27a1bae-0696-4427-b580-ec137f849153 with Priority: HIGHEST for action port [ 635.842951] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_rules [ 635.843507] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 635.843507] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b27a1bae-0696-4427-b580-ec137f849153 with Priority: HIGHEST for action port [ 635.843507] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.843617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.843652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.844350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.844350] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.844936] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.845060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.845267] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-b27a1bae-0696-4427-b580-ec137f849153 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.845364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b27a1bae-0696-4427-b580-ec137f849153" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.845422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b27a1bae-0696-4427-b580-ec137f849153" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.845660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b27a1bae-0696-4427-b580-ec137f849153" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.845740] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b27a1bae-0696-4427-b580-ec137f849153',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.349422] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.349422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.352949] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b27a1bae-0696-4427-b580-ec137f849153 with status ACTIVE [ 636.353180] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.353284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.353339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.353679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.353857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.354189] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.354189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.354323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.354530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.356068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.356068] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.356068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.356068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.356068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.356068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.356068] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b27a1bae-0696-4427-b580-ec137f849153 is going to be updated. [ 636.381501] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.381501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.381501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.381501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.381777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.381777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b27a1bae-0696-4427-b580-ec137f849153" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.668893] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: SUCCESS [ 636.669091] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 deletion is rescheduled due to dependency. [ 636.669210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.669370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.669635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.669822] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.669936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.670006] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.670173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.670258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.670354] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.035079] env[65553]: INFO networking_nsxv3.common.synchronization [None req-1ad783f3-19d9-45fd-9ea9-0ba7ef211eab tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_rules [ 637.035849] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_rules [ 637.036105] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5850b07-8815-476d-8023-18db057487e0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.036586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.036586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.036823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.036823] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.038469] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: SUCCESS [ 637.038539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.038931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.039138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.039322] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.039454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.039518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.039669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.039750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.039837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.039923] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.109026] env[65553]: INFO networking_nsxv3.common.synchronization [None req-2d91c5c0-5095-453f-af96-4e4c4f93faff None None] Enqueued Resource ID: a70d543d-b2c3-440a-a318-c13428c56c02 with Priority: HIGHEST for action port [ 637.109786] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a70d543d-b2c3-440a-a318-c13428c56c02 with Priority: HIGHEST for action port [ 637.110882] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-a70d543d-b2c3-440a-a318-c13428c56c02 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.111148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a70d543d-b2c3-440a-a318-c13428c56c02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.111283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a70d543d-b2c3-440a-a318-c13428c56c02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.112327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a70d543d-b2c3-440a-a318-c13428c56c02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.112431] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a70d543d-b2c3-440a-a318-c13428c56c02',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.135024] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d1024268-f840-4915-8ef7-663e406f494d tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_rules [ 637.135024] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_rules [ 637.135024] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5850b07-8815-476d-8023-18db057487e0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.135024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.172513] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.545242] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.562519] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.563039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.563039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.563208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.563208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.563278] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5850b07-8815-476d-8023-18db057487e0 already deleted. [ 637.563383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.563497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.563666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.563741] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.616114] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a70d543d-b2c3-440a-a318-c13428c56c02 [ 637.616337] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.616594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.616703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.616878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.616965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.617072] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a70d543d-b2c3-440a-a318-c13428c56c02 already deleted. [ 637.617167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a70d543d-b2c3-440a-a318-c13428c56c02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.676671] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.049253] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ed73c0e-357c-432a-a683-eda251f6d85a: rpc.has_security_group_logging(os_id): False [ 638.070970] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.071124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.071226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.071481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.071598] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.071924] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.072132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.072228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.072459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.072854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.072854] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a is going to be created. [ 638.084325] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.084325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.084325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.084325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.084325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.084325] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5850b07-8815-476d-8023-18db057487e0 already deleted. [ 638.084325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.138142] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.138499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.138673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.138996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.139294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.152602] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: IN_PROGRESS for 2s [ 638.178937] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.179159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.179207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.179890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.180106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.180221] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 is going to be updated. [ 638.220571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.220810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.220810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.221908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.221908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.231725] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: IN_PROGRESS for 2s [ 638.388951] env[65553]: INFO networking_nsxv3.common.synchronization [req-4886b45b-1dc1-4a27-b537-dd77e67edadd req-dee5dc41-d75d-48a7-b4c6-0b0d9181a92f tempest-ServerDiagnosticsNegativeTest-25065579 tempest-ServerDiagnosticsNegativeTest-25065579-project-member] Enqueued Resource ID: de664cf7-0945-48b8-9372-6d843b23be0e with Priority: HIGHEST for action security_group_members [ 638.388951] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de664cf7-0945-48b8-9372-6d843b23be0e with Priority: HIGHEST for action security_group_members [ 638.389678] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-de664cf7-0945-48b8-9372-6d843b23be0e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.389784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.389940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.390396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.390698] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.390864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.390956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.391165] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.391260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.391364] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de664cf7-0945-48b8-9372-6d843b23be0e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.743308] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.743657] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.743835] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.746521] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.746878] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.747082] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.747202] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.747489] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.747589] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.747838] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.747984] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.748204] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.748271] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.748358] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.748458] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.748581] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.773579] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.773579] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.773579] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.773579] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.773579] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-5c99df99-227f-48ed-ab7d-586ee9609f07 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.773579] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-5c99df99-227f-48ed-ab7d-586ee9609f07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.773579] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-5c99df99-227f-48ed-ab7d-586ee9609f07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.773579] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-5c99df99-227f-48ed-ab7d-586ee9609f07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.773579] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c99df99-227f-48ed-ab7d-586ee9609f07',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.896277] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.896277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.896277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.896277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.896277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.896769] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.896769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.896769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.896769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.897019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.897019] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de664cf7-0945-48b8-9372-6d843b23be0e already deleted. [ 638.897019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.276477] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.276886] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.277387] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.277860] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.278073] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.278234] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 5c99df99-227f-48ed-ab7d-586ee9609f07 not found, creating... [ 639.278515] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.278781] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.278946] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.279239] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.279405] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.279695] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.279909] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.280032] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.280474] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.280652] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.280954] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 5c99df99-227f-48ed-ab7d-586ee9609f07 is going to be created. [ 639.304935] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.305220] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.305220] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.306207] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.306207] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.306207] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-5c99df99-227f-48ed-ab7d-586ee9609f07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.028639] env[65553]: INFO networking_nsxv3.common.synchronization [req-4886b45b-1dc1-4a27-b537-dd77e67edadd req-f747c88f-5a0f-4e2c-be37-bc41a4801104 service nova] Enqueued Resource ID: de664cf7-0945-48b8-9372-6d843b23be0e with Priority: HIGHEST for action security_group_rules [ 640.028812] env[65553]: INFO networking_nsxv3.common.synchronization [req-4886b45b-1dc1-4a27-b537-dd77e67edadd req-f747c88f-5a0f-4e2c-be37-bc41a4801104 service nova] Enqueued Resource ID: de664cf7-0945-48b8-9372-6d843b23be0e with Priority: HIGHEST for action security_group_members [ 640.028945] env[65553]: INFO networking_nsxv3.common.synchronization [req-4886b45b-1dc1-4a27-b537-dd77e67edadd req-f747c88f-5a0f-4e2c-be37-bc41a4801104 service nova] Enqueued Resource ID: 5c99df99-227f-48ed-ab7d-586ee9609f07 with Priority: HIGHEST for action port [ 640.030102] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de664cf7-0945-48b8-9372-6d843b23be0e with Priority: HIGHEST for action security_group_rules [ 640.030243] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de664cf7-0945-48b8-9372-6d843b23be0e with Priority: HIGHEST for action security_group_members [ 640.030339] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c99df99-227f-48ed-ab7d-586ee9609f07 with Priority: HIGHEST for action port [ 640.031174] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de664cf7-0945-48b8-9372-6d843b23be0e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.031293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.031364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.031786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.031786] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de664cf7-0945-48b8-9372-6d843b23be0e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.032744] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-de664cf7-0945-48b8-9372-6d843b23be0e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.032954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.033071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.033271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.033499] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.033565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.033565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.033709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.033792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.033883] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de664cf7-0945-48b8-9372-6d843b23be0e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.034826] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c99df99-227f-48ed-ab7d-586ee9609f07 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.034826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c99df99-227f-48ed-ab7d-586ee9609f07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.034826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c99df99-227f-48ed-ab7d-586ee9609f07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.035271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c99df99-227f-48ed-ab7d-586ee9609f07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.035271] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c99df99-227f-48ed-ab7d-586ee9609f07',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.167890] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: SUCCESS [ 640.168130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.242766] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: IN_PROGRESS for 4s [ 640.539762] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c99df99-227f-48ed-ab7d-586ee9609f07 with status ACTIVE [ 640.539762] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.539762] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.539762] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.539762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.539762] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c99df99-227f-48ed-ab7d-586ee9609f07 is going to be updated. [ 640.540907] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de664cf7-0945-48b8-9372-6d843b23be0e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.541767] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-de664cf7-0945-48b8-9372-6d843b23be0e taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.541919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.554532] env[65553]: INFO networking_nsxv3.common.synchronization [req-dd325e58-09ff-4850-b739-39e86b282fe6 req-4b6d2725-e544-4ef1-84d2-bd9fa28c903b tempest-AttachInterfacesV270Test-558104461 tempest-AttachInterfacesV270Test-558104461-project-member] Enqueued Resource ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 with Priority: HIGHEST for action security_group_members [ 640.554532] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 with Priority: HIGHEST for action security_group_members [ 640.556201] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-adbdb58c-5387-4b80-952f-8897a8d0f9c9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.556201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.556201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.556201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.556201] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.556201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.556597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.556597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.556746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.557650] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adbdb58c-5387-4b80-952f-8897a8d0f9c9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.579857] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.580121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.580121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.580295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.580427] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.581195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c99df99-227f-48ed-ab7d-586ee9609f07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.044925] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de664cf7-0945-48b8-9372-6d843b23be0e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.060330] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.060485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.060539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.060716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.060807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.061049] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.061160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.061226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.061420] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.061509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.061600] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 is going to be updated. [ 641.091113] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.091322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.091587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.091587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.091733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.103710] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 in Status: IN_PROGRESS for 2s [ 641.549968] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.550347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.550347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.552279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.552279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.552279] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de664cf7-0945-48b8-9372-6d843b23be0e is going to be created. [ 641.575183] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.575369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.575415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.575861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.575861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.588342] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de664cf7-0945-48b8-9372-6d843b23be0e in Status: UNINITIALIZED for 2s [ 641.745032] env[65553]: INFO networking_nsxv3.common.synchronization [req-5442c938-fb21-4923-8126-2502752705d6 req-053c4778-6092-4d53-a0d0-1a611cfbecb3 tempest-ServerMetadataNegativeTestJSON-917010991 tempest-ServerMetadataNegativeTestJSON-917010991-project-member] Enqueued Resource ID: 30f1992f-8f85-4326-932f-434571d97d70 with Priority: HIGHEST for action security_group_members [ 641.745410] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f1992f-8f85-4326-932f-434571d97d70 with Priority: HIGHEST for action security_group_members [ 641.745752] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f1992f-8f85-4326-932f-434571d97d70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.745875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.745940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.746571] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.746769] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.747063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.747063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.747310] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.747464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.747591] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30f1992f-8f85-4326-932f-434571d97d70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.249747] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.249902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.249978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.250289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.250398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.250661] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.250790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.250981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.251045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.251119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.251228] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30f1992f-8f85-4326-932f-434571d97d70 already deleted. [ 642.251285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.253716] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: SUCCESS [ 642.254518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.254518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.254518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.254518] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.254518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.254934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.254934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.254934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.254934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.255079] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.383232] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.383327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-26" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.383624] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-26" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.383904] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-26" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.384232] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.384513] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.384580] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.385941] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.385941] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.385941] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.385941] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.385941] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.385941] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.385941] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.385941] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.385941] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.404508] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.404665] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.404796] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.405055] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-26" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.405439] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-c2598d69-8a6b-4535-8133-7b27a3f429df taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.405611] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-c2598d69-8a6b-4535-8133-7b27a3f429df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.405724] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-c2598d69-8a6b-4535-8133-7b27a3f429df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.406113] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-c2598d69-8a6b-4535-8133-7b27a3f429df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.406255] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2598d69-8a6b-4535-8133-7b27a3f429df',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.758097] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.758654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.758722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.758926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.759141] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.759296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.759675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.759865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.759963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.760070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.760332] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.760577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.760669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.760842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.760988] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.761110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.761229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.761312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.761390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.761474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.761566] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.885662] env[65553]: INFO networking_nsxv3.common.synchronization [None req-34369785-807a-4698-b9e2-267968cf492c None None] Enqueued Resource ID: f48a4629-19b6-4c5e-aca0-1de397726f38 with Priority: HIGHEST for action port [ 642.886228] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f48a4629-19b6-4c5e-aca0-1de397726f38 with Priority: HIGHEST for action port [ 642.886557] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-f48a4629-19b6-4c5e-aca0-1de397726f38 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.886678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f48a4629-19b6-4c5e-aca0-1de397726f38" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.886744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f48a4629-19b6-4c5e-aca0-1de397726f38" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.886989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f48a4629-19b6-4c5e-aca0-1de397726f38" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.887246] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f48a4629-19b6-4c5e-aca0-1de397726f38',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.908618] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.911624] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.911624] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.911624] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.911624] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.911624] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port c2598d69-8a6b-4535-8133-7b27a3f429df not found, creating... [ 642.911624] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.911624] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.911624] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.911624] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.911624] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.912219] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.912219] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.912219] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.912219] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.912219] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.912219] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: c2598d69-8a6b-4535-8133-7b27a3f429df is going to be created. [ 642.933695] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.933897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.934025] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.934342] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.934568] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.934782] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-c2598d69-8a6b-4535-8133-7b27a3f429df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.116615] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 in Status: SUCCESS [ 643.116837] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 deletion is rescheduled due to dependency. [ 643.116958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.264761] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edac77c9-fa82-4dc9-b52a-a8a880305683: rpc.has_security_group_logging(os_id): False [ 643.286251] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.287064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.287064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.287291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.287291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.287521] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.287704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.287792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.288316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.288316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.288316] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.288627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.288627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.288743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.288860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.289299] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.289299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.289299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.289615] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.289615] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.290208] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 is going to be updated. [ 643.365968] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.366142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.366293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.366622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.366812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.387077] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: IN_PROGRESS for 2s [ 643.390756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f48a4629-19b6-4c5e-aca0-1de397726f38 [ 643.390756] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.390756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.390756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.390756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.390756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.390756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f48a4629-19b6-4c5e-aca0-1de397726f38 already deleted. [ 643.390756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f48a4629-19b6-4c5e-aca0-1de397726f38" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.603077] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de664cf7-0945-48b8-9372-6d843b23be0e in Status: SUCCESS [ 643.603077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.603077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.603077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.603077] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.603077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.603077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.603077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.603077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.603077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.603077] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de664cf7-0945-48b8-9372-6d843b23be0e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.730252] env[65553]: INFO networking_nsxv3.common.synchronization [req-5442c938-fb21-4923-8126-2502752705d6 req-fe25a9d4-edf2-45b2-995b-ebc4c1f269a2 service nova] Enqueued Resource ID: 30f1992f-8f85-4326-932f-434571d97d70 with Priority: HIGHEST for action security_group_rules [ 643.730445] env[65553]: INFO networking_nsxv3.common.synchronization [req-5442c938-fb21-4923-8126-2502752705d6 req-fe25a9d4-edf2-45b2-995b-ebc4c1f269a2 service nova] Enqueued Resource ID: 30f1992f-8f85-4326-932f-434571d97d70 with Priority: HIGHEST for action security_group_members [ 643.730599] env[65553]: INFO networking_nsxv3.common.synchronization [req-5442c938-fb21-4923-8126-2502752705d6 req-fe25a9d4-edf2-45b2-995b-ebc4c1f269a2 service nova] Enqueued Resource ID: c2598d69-8a6b-4535-8133-7b27a3f429df with Priority: HIGHEST for action port [ 643.731215] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f1992f-8f85-4326-932f-434571d97d70 with Priority: HIGHEST for action security_group_rules [ 643.731372] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f1992f-8f85-4326-932f-434571d97d70 with Priority: HIGHEST for action security_group_members [ 643.731484] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2598d69-8a6b-4535-8133-7b27a3f429df with Priority: HIGHEST for action port [ 643.731784] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30f1992f-8f85-4326-932f-434571d97d70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.731928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.731962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.733646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.733646] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30f1992f-8f85-4326-932f-434571d97d70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.737174] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f1992f-8f85-4326-932f-434571d97d70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.737174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.737174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.737174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.737174] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.737174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.737174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.737174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.737174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.737174] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30f1992f-8f85-4326-932f-434571d97d70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.738423] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2598d69-8a6b-4535-8133-7b27a3f429df taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.738423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2598d69-8a6b-4535-8133-7b27a3f429df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.738423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2598d69-8a6b-4535-8133-7b27a3f429df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.738423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2598d69-8a6b-4535-8133-7b27a3f429df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.738664] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2598d69-8a6b-4535-8133-7b27a3f429df',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.089023] env[65553]: INFO networking_nsxv3.common.synchronization [None req-65501a13-d3f2-4798-8261-655cf0e1a35d None None] Enqueued Resource ID: 52bd4da0-a7e0-4301-b7eb-e3196cee3e08 with Priority: HIGHEST for action port [ 644.089023] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52bd4da0-a7e0-4301-b7eb-e3196cee3e08 with Priority: HIGHEST for action port [ 644.089023] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-52bd4da0-a7e0-4301-b7eb-e3196cee3e08 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.089023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52bd4da0-a7e0-4301-b7eb-e3196cee3e08" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.089023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52bd4da0-a7e0-4301-b7eb-e3196cee3e08" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.090924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52bd4da0-a7e0-4301-b7eb-e3196cee3e08" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.090924] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52bd4da0-a7e0-4301-b7eb-e3196cee3e08',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.107131] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-de664cf7-0945-48b8-9372-6d843b23be0e taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.107318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.107422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.107689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.107944] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.108154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.108154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.108873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.108873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.108873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.108873] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-de664cf7-0945-48b8-9372-6d843b23be0e taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.108873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.108873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.108873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.109212] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.109372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.109372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.109520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.109616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.113544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.113544] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de664cf7-0945-48b8-9372-6d843b23be0e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.247021] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30f1992f-8f85-4326-932f-434571d97d70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.247021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f1992f-8f85-4326-932f-434571d97d70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.247021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.247021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2598d69-8a6b-4535-8133-7b27a3f429df with status ACTIVE [ 644.247021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.247349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.247723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.247723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.247960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.247960] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.248052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.248093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.248964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.249108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.249305] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.249438] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.249474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.249607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.249680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.249760] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2598d69-8a6b-4535-8133-7b27a3f429df is going to be updated. [ 644.278416] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.278588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.278652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.278833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.278971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.279537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2598d69-8a6b-4535-8133-7b27a3f429df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.594287] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52bd4da0-a7e0-4301-b7eb-e3196cee3e08 [ 644.594287] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.594287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.594287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.594287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.594287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.594287] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52bd4da0-a7e0-4301-b7eb-e3196cee3e08 already deleted. [ 644.594287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52bd4da0-a7e0-4301-b7eb-e3196cee3e08" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.616579] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de664cf7-0945-48b8-9372-6d843b23be0e: rpc.has_security_group_logging(os_id): False [ 644.638297] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.638297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.639030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.639229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.639229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.639750] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.639750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.639750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.640093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.640262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.640513] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.640642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.640728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.640926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.643519] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.644830] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.644951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.644994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.645188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.645331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.645471] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de664cf7-0945-48b8-9372-6d843b23be0e is going to be created. [ 644.705724] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.706324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.706324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.706324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.706570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.722983] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de664cf7-0945-48b8-9372-6d843b23be0e in Status: IN_PROGRESS for 2s [ 644.753076] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30f1992f-8f85-4326-932f-434571d97d70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.856037] env[65553]: INFO networking_nsxv3.common.synchronization [req-7fb39cea-7ca7-4b83-a72e-fa73a7fe8de1 req-8364d984-9d87-43e4-9f3e-18fb98779d36 tempest-VolumesAdminNegativeTest-424044938 tempest-VolumesAdminNegativeTest-424044938-project-member] Enqueued Resource ID: 47ac6222-df91-40b6-8703-f88ab52afe33 with Priority: HIGHEST for action security_group_members [ 644.856824] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ac6222-df91-40b6-8703-f88ab52afe33 with Priority: HIGHEST for action security_group_members [ 644.856937] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-47ac6222-df91-40b6-8703-f88ab52afe33 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.860133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.860133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.860133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.860133] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.860133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.860133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.860133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.860133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.860133] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47ac6222-df91-40b6-8703-f88ab52afe33',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.257317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.257737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.257737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.257930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.257930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.257930] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30f1992f-8f85-4326-932f-434571d97d70 is going to be created. [ 645.284961] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.285211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.285211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.285473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.285636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.301123] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30f1992f-8f85-4326-932f-434571d97d70 in Status: UNINITIALIZED for 2s [ 645.365143] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.365143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.365143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.365143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.365143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.365143] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.365143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.365143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.365143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.365143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.365143] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ac6222-df91-40b6-8703-f88ab52afe33 is going to be updated. [ 645.398137] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.398137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.398137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.398137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.398137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.401218] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: SUCCESS [ 645.401561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.407050] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ac6222-df91-40b6-8703-f88ab52afe33 in Status: IN_PROGRESS for 2s [ 645.534839] env[65553]: INFO networking_nsxv3.common.synchronization [None req-139c5c34-0887-47d0-b72e-b3d19aeeb4db None None] Enqueued Resource ID: cbc15ab6-c872-47e8-9ff5-c63c62a8d9b1 with Priority: HIGHEST for action port [ 645.535699] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc15ab6-c872-47e8-9ff5-c63c62a8d9b1 with Priority: HIGHEST for action port [ 645.535915] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbc15ab6-c872-47e8-9ff5-c63c62a8d9b1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.536357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbc15ab6-c872-47e8-9ff5-c63c62a8d9b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.536504] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbc15ab6-c872-47e8-9ff5-c63c62a8d9b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.536857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbc15ab6-c872-47e8-9ff5-c63c62a8d9b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.536978] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbc15ab6-c872-47e8-9ff5-c63c62a8d9b1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.969780] env[65553]: INFO networking_nsxv3.common.synchronization [None req-b9452cd3-80bf-4a8f-896e-a6a73ad6a610 None None] Enqueued Resource ID: c033421f-7fef-471b-ad90-83e59e6781d7 with Priority: HIGHEST for action port [ 645.970499] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c033421f-7fef-471b-ad90-83e59e6781d7 with Priority: HIGHEST for action port [ 645.970547] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c033421f-7fef-471b-ad90-83e59e6781d7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.970632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c033421f-7fef-471b-ad90-83e59e6781d7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.970776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c033421f-7fef-471b-ad90-83e59e6781d7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.970990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c033421f-7fef-471b-ad90-83e59e6781d7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.971460] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c033421f-7fef-471b-ad90-83e59e6781d7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.038745] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbc15ab6-c872-47e8-9ff5-c63c62a8d9b1 [ 646.039573] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.039833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.039948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.040232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.040335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.040782] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbc15ab6-c872-47e8-9ff5-c63c62a8d9b1 already deleted. [ 646.040782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbc15ab6-c872-47e8-9ff5-c63c62a8d9b1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.421024] env[65553]: INFO networking_nsxv3.common.synchronization [None req-e4cd74df-afbb-4af3-901f-e2a97bc0c0ba None None] Enqueued Resource ID: 740c1f48-596f-4306-b512-3375c05efdd2 with Priority: HIGHEST for action port [ 646.421024] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740c1f48-596f-4306-b512-3375c05efdd2 with Priority: HIGHEST for action port [ 646.421024] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-740c1f48-596f-4306-b512-3375c05efdd2 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.421024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-740c1f48-596f-4306-b512-3375c05efdd2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.421024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-740c1f48-596f-4306-b512-3375c05efdd2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.421024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-740c1f48-596f-4306-b512-3375c05efdd2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.421024] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('740c1f48-596f-4306-b512-3375c05efdd2',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.474959] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c033421f-7fef-471b-ad90-83e59e6781d7 [ 646.475240] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.475411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.475481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.475698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.475788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.475882] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c033421f-7fef-471b-ad90-83e59e6781d7 already deleted. [ 646.475987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c033421f-7fef-471b-ad90-83e59e6781d7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.742144] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de664cf7-0945-48b8-9372-6d843b23be0e in Status: SUCCESS [ 646.742378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.751020] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d4744ebc-173d-4dd0-92e8-b6fdcb01afa8 None None] Enqueued Resource ID: 52f1396f-7396-42f2-9a82-85cb7b847c9a with Priority: HIGHEST for action port [ 646.751242] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f1396f-7396-42f2-9a82-85cb7b847c9a with Priority: HIGHEST for action port [ 646.751631] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-52f1396f-7396-42f2-9a82-85cb7b847c9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.751758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52f1396f-7396-42f2-9a82-85cb7b847c9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.751868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52f1396f-7396-42f2-9a82-85cb7b847c9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.752407] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52f1396f-7396-42f2-9a82-85cb7b847c9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.752517] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f1396f-7396-42f2-9a82-85cb7b847c9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.922851] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 740c1f48-596f-4306-b512-3375c05efdd2 [ 646.923132] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.923236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.923455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.923517] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.923737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.923737] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:740c1f48-596f-4306-b512-3375c05efdd2 already deleted. [ 646.923824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-740c1f48-596f-4306-b512-3375c05efdd2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.257850] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52f1396f-7396-42f2-9a82-85cb7b847c9a [ 647.257850] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.257850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.257850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.257850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.257850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.257850] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52f1396f-7396-42f2-9a82-85cb7b847c9a already deleted. [ 647.257850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52f1396f-7396-42f2-9a82-85cb7b847c9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.316399] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30f1992f-8f85-4326-932f-434571d97d70 in Status: SUCCESS [ 647.316604] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.316790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.317056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.317342] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.317466] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.317591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.317696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.317800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.317920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.318036] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30f1992f-8f85-4326-932f-434571d97d70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.420841] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47ac6222-df91-40b6-8703-f88ab52afe33 in Status: SUCCESS [ 647.421035] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47ac6222-df91-40b6-8703-f88ab52afe33 deletion is rescheduled due to dependency. [ 647.421789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.820390] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f1992f-8f85-4326-932f-434571d97d70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.821189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.821189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.821189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.821189] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.821189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.821460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.821460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.821527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.821601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.821728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f1992f-8f85-4326-932f-434571d97d70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.821961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.821961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.822106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.822840] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.822840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.822840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.822840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.822840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.822840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.822840] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30f1992f-8f85-4326-932f-434571d97d70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.327762] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30f1992f-8f85-4326-932f-434571d97d70: rpc.has_security_group_logging(os_id): False [ 648.361076] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.361076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.361076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.361076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.361076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.361307] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.362785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.362785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.362785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.362785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.362785] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.362785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.362785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.362785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.362785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.363372] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.363372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.363372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.363372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.363372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.363589] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30f1992f-8f85-4326-932f-434571d97d70 is going to be created. [ 648.438029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.438428] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.438428] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.438517] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.438665] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.459405] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30f1992f-8f85-4326-932f-434571d97d70 in Status: IN_PROGRESS for 2s [ 650.386590] env[65553]: INFO networking_nsxv3.common.synchronization [req-1c69f417-9c04-4d9e-89ab-ad69ee3784cd req-b7b59860-2dd3-4492-82b8-d57c01fd8566 tempest-MigrationsAdminTest-418950081 tempest-MigrationsAdminTest-418950081-project-member] Enqueued Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 650.388066] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 650.389025] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.389025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.389025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.389025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.389323] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.389440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.389594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.389823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.390018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.390232] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.473697] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30f1992f-8f85-4326-932f-434571d97d70 in Status: SUCCESS [ 650.473980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.791199] env[65553]: INFO networking_nsxv3.common.synchronization [None req-76ae3473-d30a-42a5-a06c-886d1170a41e tempest-ServersTestBootFromVolume-1810122885 tempest-ServersTestBootFromVolume-1810122885-project-member] Enqueued Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_rules [ 650.791871] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_rules [ 650.796916] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a425597-2f3a-4763-9abe-b15432eceec7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.797131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.797228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.797668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.797793] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.893891] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.894055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.894135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.894375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.894472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.894690] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.895652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.895652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.895652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.895652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.895652] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 already deleted. [ 650.895652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.029425] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.029425] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.029425] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.029425] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.029425] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.029425] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.029425] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.029425] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.029425] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.029425] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.029425] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.029425] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.029425] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.030928] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.030928] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.030928] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.056453] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.056744] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 651.056936] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.057143] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.057464] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-5a8889a6-96cb-4472-ab0e-d269f8f82807 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.057639] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-5a8889a6-96cb-4472-ab0e-d269f8f82807" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.057805] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-5a8889a6-96cb-4472-ab0e-d269f8f82807" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.058327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-5a8889a6-96cb-4472-ab0e-d269f8f82807" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.058327] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a8889a6-96cb-4472-ab0e-d269f8f82807',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.063852] env[65553]: INFO networking_nsxv3.common.synchronization [None req-b4774822-869b-4605-88c3-311b6408edd2 None None] Enqueued Resource ID: c11c892e-a263-423c-ac67-b57fcd20b0d5 with Priority: HIGHEST for action port [ 651.064780] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c11c892e-a263-423c-ac67-b57fcd20b0d5 with Priority: HIGHEST for action port [ 651.065057] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c11c892e-a263-423c-ac67-b57fcd20b0d5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.065221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c11c892e-a263-423c-ac67-b57fcd20b0d5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.065346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c11c892e-a263-423c-ac67-b57fcd20b0d5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.065608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c11c892e-a263-423c-ac67-b57fcd20b0d5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.065691] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c11c892e-a263-423c-ac67-b57fcd20b0d5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.102373] env[65553]: INFO networking_nsxv3.common.synchronization [None req-cfed2e6b-b413-4458-8de5-b800131f8d07 None None] Enqueued Resource ID: 7bc326c2-2645-44e4-a545-a38c961e7541 with Priority: HIGHEST for action port [ 651.102837] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc326c2-2645-44e4-a545-a38c961e7541 with Priority: HIGHEST for action port [ 651.103732] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bc326c2-2645-44e4-a545-a38c961e7541 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.103864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bc326c2-2645-44e4-a545-a38c961e7541" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.103952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bc326c2-2645-44e4-a545-a38c961e7541" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.104241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bc326c2-2645-44e4-a545-a38c961e7541" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.104344] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bc326c2-2645-44e4-a545-a38c961e7541',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.319922] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.320145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.320216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.320474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.320705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.320705] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a425597-2f3a-4763-9abe-b15432eceec7 already deleted. [ 651.321057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.563740] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.564626] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.566070] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.566070] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.566070] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.566070] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 5a8889a6-96cb-4472-ab0e-d269f8f82807 not found, creating... [ 651.566270] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.566375] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.566523] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.566768] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.566900] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.567280] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.567607] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.567723] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.567943] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.568092] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.568226] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 5a8889a6-96cb-4472-ab0e-d269f8f82807 is going to be created. [ 651.569438] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c11c892e-a263-423c-ac67-b57fcd20b0d5 [ 651.569605] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.569714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.569774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.569928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.570024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.570102] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c11c892e-a263-423c-ac67-b57fcd20b0d5 already deleted. [ 651.570184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c11c892e-a263-423c-ac67-b57fcd20b0d5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.591679] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.592203] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.592203] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.592325] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.592607] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.592750] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-5a8889a6-96cb-4472-ab0e-d269f8f82807" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.606296] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bc326c2-2645-44e4-a545-a38c961e7541 [ 651.606672] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.606672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.607054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.607054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.607054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.607185] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bc326c2-2645-44e4-a545-a38c961e7541 already deleted. [ 651.607185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bc326c2-2645-44e4-a545-a38c961e7541" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.378743] env[65553]: INFO networking_nsxv3.common.synchronization [req-1c69f417-9c04-4d9e-89ab-ad69ee3784cd req-fcc02ddb-8883-4d25-8393-d06142465bab service nova] Enqueued Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_rules [ 652.378743] env[65553]: INFO networking_nsxv3.common.synchronization [req-1c69f417-9c04-4d9e-89ab-ad69ee3784cd req-fcc02ddb-8883-4d25-8393-d06142465bab service nova] Enqueued Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 652.378743] env[65553]: INFO networking_nsxv3.common.synchronization [req-1c69f417-9c04-4d9e-89ab-ad69ee3784cd req-fcc02ddb-8883-4d25-8393-d06142465bab service nova] Enqueued Resource ID: 5a8889a6-96cb-4472-ab0e-d269f8f82807 with Priority: HIGHEST for action port [ 652.379289] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_rules [ 652.379556] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 652.379760] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a8889a6-96cb-4472-ab0e-d269f8f82807 with Priority: HIGHEST for action port [ 652.380218] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.380409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.380515] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.381030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.381030] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.382497] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.382622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.382687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.382908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.383115] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.383255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.383322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.383475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.383563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.383656] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.384580] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a8889a6-96cb-4472-ab0e-d269f8f82807 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.384721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a8889a6-96cb-4472-ab0e-d269f8f82807" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.384791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a8889a6-96cb-4472-ab0e-d269f8f82807" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.384947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a8889a6-96cb-4472-ab0e-d269f8f82807" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.385028] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a8889a6-96cb-4472-ab0e-d269f8f82807',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.516151] env[65553]: INFO networking_nsxv3.common.synchronization [None req-b9fdaaad-a737-458b-9044-7649a8aa77f5 tempest-ServersTestBootFromVolume-1810122885 tempest-ServersTestBootFromVolume-1810122885-project-member] Enqueued Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_rules [ 652.516713] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_rules [ 652.516974] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a425597-2f3a-4763-9abe-b15432eceec7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.517482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.517482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.517482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.517482] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.613911] env[65553]: INFO networking_nsxv3.common.synchronization [None req-22a0d486-09dc-4262-ad78-8b253012a0e8 None None] Enqueued Resource ID: 9b386a3b-0165-4df4-a4ed-9b402fdef3da with Priority: HIGHEST for action port [ 652.615569] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b386a3b-0165-4df4-a4ed-9b402fdef3da with Priority: HIGHEST for action port [ 652.616171] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b386a3b-0165-4df4-a4ed-9b402fdef3da taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.616171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b386a3b-0165-4df4-a4ed-9b402fdef3da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.616171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b386a3b-0165-4df4-a4ed-9b402fdef3da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.616354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b386a3b-0165-4df4-a4ed-9b402fdef3da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.616393] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b386a3b-0165-4df4-a4ed-9b402fdef3da',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.887192] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.887406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.887654] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.888964] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a8889a6-96cb-4472-ab0e-d269f8f82807 with status ACTIVE [ 652.889154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.889300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.889370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.889723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.889823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.890012] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.890124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.890186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.890351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.890426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.890607] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.890805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.890805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.891033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.891033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.891137] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a8889a6-96cb-4472-ab0e-d269f8f82807 is going to be updated. [ 652.924920] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.924920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.924920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.925474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.925474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.925799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a8889a6-96cb-4472-ab0e-d269f8f82807" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.047622] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.047622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.047622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.047622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.047622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.047622] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a425597-2f3a-4763-9abe-b15432eceec7 already deleted. [ 653.047622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.118667] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b386a3b-0165-4df4-a4ed-9b402fdef3da [ 653.118667] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.118993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.119083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.119303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.119395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.119684] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b386a3b-0165-4df4-a4ed-9b402fdef3da already deleted. [ 653.119684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b386a3b-0165-4df4-a4ed-9b402fdef3da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.394032] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.630569] env[65553]: INFO networking_nsxv3.common.synchronization [None req-bf8c37b3-aced-46b8-be12-aa42a7bde33a None None] Enqueued Resource ID: fe60e9d7-80cd-4af4-87c6-400fa7c554e0 with Priority: HIGHEST for action port [ 653.631256] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe60e9d7-80cd-4af4-87c6-400fa7c554e0 with Priority: HIGHEST for action port [ 653.631583] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe60e9d7-80cd-4af4-87c6-400fa7c554e0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.631736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe60e9d7-80cd-4af4-87c6-400fa7c554e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.631815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe60e9d7-80cd-4af4-87c6-400fa7c554e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.632620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe60e9d7-80cd-4af4-87c6-400fa7c554e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.632620] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe60e9d7-80cd-4af4-87c6-400fa7c554e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.898468] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.898654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.898715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.899346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.899346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.899346] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 is going to be created. [ 653.940395] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.940533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.940533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.940751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.940899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.955076] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: UNINITIALIZED for 2s [ 654.139896] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe60e9d7-80cd-4af4-87c6-400fa7c554e0 [ 654.140407] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.140407] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.140660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.140698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.140772] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.140875] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe60e9d7-80cd-4af4-87c6-400fa7c554e0 already deleted. [ 654.140959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe60e9d7-80cd-4af4-87c6-400fa7c554e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.183925] env[65553]: INFO networking_nsxv3.common.synchronization [req-2ef279e8-f67c-496b-9e65-f0010ba5b70d req-eba17654-37c7-438f-80cb-9cfda3d88748 tempest-ImagesTestJSON-1118693169 tempest-ImagesTestJSON-1118693169-project-member] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 654.183925] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 654.183925] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.187062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.187245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.187498] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.187600] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.187736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.187776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.189761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.189761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.189761] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.587138] env[65553]: INFO networking_nsxv3.common.synchronization [req-bee6cff3-2e87-4e9b-8b9f-0263a063a3d2 req-bb0d9c76-ba84-42ef-a961-b6f5981bd87b tempest-TenantUsagesTestJSON-69369519 tempest-TenantUsagesTestJSON-69369519-project-member] Enqueued Resource ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae with Priority: HIGHEST for action security_group_members [ 654.587138] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae with Priority: HIGHEST for action security_group_members [ 654.587138] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.587138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.587138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.587138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.587138] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.587138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.587138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.587975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.588192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.588401] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54d93d69-4c1f-45f9-bd84-41ef7facb6ae',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.690328] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.691509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.691509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.691509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.691509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.691509] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.691509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.691509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.691762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.691762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.691762] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 654.729000] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.729000] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.729000] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.729000] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.729000] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.738537] env[65553]: INFO networking_nsxv3.common.synchronization [req-7dd6ed91-dc97-42d0-b8ec-075a9e43a83e req-db3b85a5-95dd-4b76-b04e-55e0bab692da tempest-SecurityGroupRulesTestJSON-49115618 tempest-SecurityGroupRulesTestJSON-49115618-project-member] Enqueued Resource ID: 94b72d00-d70b-4958-8dd9-353dc127582c with Priority: HIGHEST for action security_group_rules [ 654.739505] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 654.742639] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b72d00-d70b-4958-8dd9-353dc127582c with Priority: HIGHEST for action security_group_rules [ 654.744096] env[65553]: INFO networking_nsxv3.common.synchronization [None req-9a2258fb-b4b7-4a34-bc81-58d2fe4c8895 None None] Enqueued Resource ID: 82b8c266-9cfc-432e-8d37-a1c288d513e0 with Priority: HIGHEST for action port [ 654.744557] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94b72d00-d70b-4958-8dd9-353dc127582c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.744666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94b72d00-d70b-4958-8dd9-353dc127582c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.744731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94b72d00-d70b-4958-8dd9-353dc127582c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.745306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94b72d00-d70b-4958-8dd9-353dc127582c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.746961] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94b72d00-d70b-4958-8dd9-353dc127582c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.748418] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82b8c266-9cfc-432e-8d37-a1c288d513e0 with Priority: HIGHEST for action port [ 654.749241] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-82b8c266-9cfc-432e-8d37-a1c288d513e0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.749241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82b8c266-9cfc-432e-8d37-a1c288d513e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.749241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82b8c266-9cfc-432e-8d37-a1c288d513e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.749383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82b8c266-9cfc-432e-8d37-a1c288d513e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.749383] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82b8c266-9cfc-432e-8d37-a1c288d513e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.092962] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.093111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.093198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.093411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.093507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.093715] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.093814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.093884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.094035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.094119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.094206] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae is going to be updated. [ 655.131390] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.131635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.131635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.131848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.131989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.144719] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae in Status: IN_PROGRESS for 2s [ 655.252492] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82b8c266-9cfc-432e-8d37-a1c288d513e0 [ 655.252685] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.252685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.252801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.252968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.253078] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.253678] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82b8c266-9cfc-432e-8d37-a1c288d513e0 already deleted. [ 655.253871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82b8c266-9cfc-432e-8d37-a1c288d513e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.280503] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.282299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.282299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.282299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.282299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.282299] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94b72d00-d70b-4958-8dd9-353dc127582c already deleted. [ 655.282299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94b72d00-d70b-4958-8dd9-353dc127582c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.501216] env[65553]: INFO networking_nsxv3.common.synchronization [req-814b9d5b-58ac-4474-b899-b1721d58bed4 req-34c5a897-c365-44a3-a25a-f989e20789e9 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_members [ 655.501425] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_members [ 655.504322] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5850b07-8815-476d-8023-18db057487e0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.504322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.504322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.504322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.504942] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.504942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.504942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.504942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.505212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.505212] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.964831] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: SUCCESS [ 655.965215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.965281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.965528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.965697] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.965823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.965886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.966059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.966136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.966223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.966686] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.009309] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.009532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.009928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.009928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.010103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.010407] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.010558] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.010696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.010861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.010969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.011111] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5850b07-8815-476d-8023-18db057487e0 already deleted. [ 656.011222] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.075214] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.075214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.075214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.075214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.075214] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.075214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.075214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.075214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.075753] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.075753] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.075958] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.076541] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.076669] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.076669] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.076783] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.077184] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.104261] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.104473] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.104555] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.104850] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.105395] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-7c6188ae-a5bd-41ba-b0b7-f42fc27af603 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.105854] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-7c6188ae-a5bd-41ba-b0b7-f42fc27af603" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.105854] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-7c6188ae-a5bd-41ba-b0b7-f42fc27af603" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.106012] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-7c6188ae-a5bd-41ba-b0b7-f42fc27af603" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.106148] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c6188ae-a5bd-41ba-b0b7-f42fc27af603',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.340530] env[65553]: INFO networking_nsxv3.common.synchronization [None req-aa747756-405f-4eab-8d2f-e4055e0a966e None None] Enqueued Resource ID: c4e58a0e-e6f9-4f29-b643-8b1be5841246 with Priority: HIGHEST for action port [ 656.340914] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4e58a0e-e6f9-4f29-b643-8b1be5841246 with Priority: HIGHEST for action port [ 656.341229] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4e58a0e-e6f9-4f29-b643-8b1be5841246 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.341363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4e58a0e-e6f9-4f29-b643-8b1be5841246" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.341600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4e58a0e-e6f9-4f29-b643-8b1be5841246" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.341686] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4e58a0e-e6f9-4f29-b643-8b1be5841246" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.341759] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4e58a0e-e6f9-4f29-b643-8b1be5841246',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.469115] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.469397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.469397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.469581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.469715] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.469854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.469854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.470030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.470120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.470207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.470488] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.470488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.470662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.470712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.470811] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.470994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.471056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.471200] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.471305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.471363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.471443] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.608622] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.608826] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.608951] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.609285] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.609552] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.609896] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 7c6188ae-a5bd-41ba-b0b7-f42fc27af603 not found, creating... [ 656.609896] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.610048] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.610226] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.610622] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.610622] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.610961] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.611047] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.611144] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.611315] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.611447] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.611572] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 7c6188ae-a5bd-41ba-b0b7-f42fc27af603 is going to be created. [ 656.633971] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.634402] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.634597] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.635905] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.636220] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.636874] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-7c6188ae-a5bd-41ba-b0b7-f42fc27af603" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.804728] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 656.804913] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 deletion is rescheduled due to dependency. [ 656.805067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.843614] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4e58a0e-e6f9-4f29-b643-8b1be5841246 [ 656.843834] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.843974] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.844070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.844346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.844458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.844549] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4e58a0e-e6f9-4f29-b643-8b1be5841246 already deleted. [ 656.844681] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4e58a0e-e6f9-4f29-b643-8b1be5841246" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.975750] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c7019e3-cf34-4117-9224-cf7758cc0cf6: rpc.has_security_group_logging(os_id): False [ 656.999248] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.999248] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.999248] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.999248] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.999589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.999589] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.999801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.999840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.000042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.000140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.000363] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.000681] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.001728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.001904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.002041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.002940] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.002940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.002940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.002940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.002940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.002940] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 is going to be created. [ 657.067437] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.067437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.067777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.067777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.069807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.083814] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: IN_PROGRESS for 2s [ 657.164599] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae in Status: SUCCESS [ 657.164786] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54d93d69-4c1f-45f9-bd84-41ef7facb6ae deletion is rescheduled due to dependency. [ 657.164903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54d93d69-4c1f-45f9-bd84-41ef7facb6ae" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.411183] env[65553]: INFO networking_nsxv3.common.synchronization [req-814b9d5b-58ac-4474-b899-b1721d58bed4 req-7fa0e261-3e59-4fc6-870b-86329f941c9e service nova] Enqueued Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_rules [ 657.411351] env[65553]: INFO networking_nsxv3.common.synchronization [req-814b9d5b-58ac-4474-b899-b1721d58bed4 req-7fa0e261-3e59-4fc6-870b-86329f941c9e service nova] Enqueued Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_members [ 657.411480] env[65553]: INFO networking_nsxv3.common.synchronization [req-814b9d5b-58ac-4474-b899-b1721d58bed4 req-7fa0e261-3e59-4fc6-870b-86329f941c9e service nova] Enqueued Resource ID: 7c6188ae-a5bd-41ba-b0b7-f42fc27af603 with Priority: HIGHEST for action port [ 657.412301] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_rules [ 657.412643] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_members [ 657.412724] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6188ae-a5bd-41ba-b0b7-f42fc27af603 with Priority: HIGHEST for action port [ 657.413327] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5850b07-8815-476d-8023-18db057487e0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.413327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.413327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.413561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.414735] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.417245] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5850b07-8815-476d-8023-18db057487e0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.417387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.417455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.417668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.418030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.418095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.418132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.418372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.418503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.418670] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.421184] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c6188ae-a5bd-41ba-b0b7-f42fc27af603 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.421184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c6188ae-a5bd-41ba-b0b7-f42fc27af603" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.421184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c6188ae-a5bd-41ba-b0b7-f42fc27af603" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.421857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c6188ae-a5bd-41ba-b0b7-f42fc27af603" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.421950] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c6188ae-a5bd-41ba-b0b7-f42fc27af603',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.693287] env[65553]: INFO networking_nsxv3.common.synchronization [req-db8b46ee-f69a-42a0-be0b-a5676cb3dae7 req-34c6a005-8629-4dde-9315-96f522cd862c tempest-FloatingIPsAssociationTestJSON-1444757961 tempest-FloatingIPsAssociationTestJSON-1444757961-project-member] Enqueued Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 657.693287] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 657.693287] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.693287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.693685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.693760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.694254] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.694254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.694254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.694637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.694734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.694830] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.905314] env[65553]: INFO networking_nsxv3.common.synchronization [req-c3be8f2e-8f20-41ed-bee5-449fd023ff9a req-ef825d23-06bc-4751-a277-ae6cafc1072d tempest-SecurityGroupRulesNegativeTestJSON-119005519 tempest-SecurityGroupRulesNegativeTestJSON-119005519-project-member] Enqueued Resource ID: 08ed6a18-afa2-4545-884c-6065de6a6744 with Priority: HIGHEST for action security_group_rules [ 657.905900] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08ed6a18-afa2-4545-884c-6065de6a6744 with Priority: HIGHEST for action security_group_rules [ 657.906481] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08ed6a18-afa2-4545-884c-6065de6a6744 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.906481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08ed6a18-afa2-4545-884c-6065de6a6744" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.906481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08ed6a18-afa2-4545-884c-6065de6a6744" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.906637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08ed6a18-afa2-4545-884c-6065de6a6744" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.906722] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08ed6a18-afa2-4545-884c-6065de6a6744',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.926426] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c6188ae-a5bd-41ba-b0b7-f42fc27af603 with status ACTIVE [ 657.926638] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.926774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.926844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.927173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.927173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.927333] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.927432] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.927494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.927649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.927728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.928027] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.928138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.928184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.928453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.928530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.928615] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c6188ae-a5bd-41ba-b0b7-f42fc27af603 is going to be updated. [ 657.929757] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.935527] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5850b07-8815-476d-8023-18db057487e0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.935527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.958082] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.958281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.958373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.958659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.958872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.959144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c6188ae-a5bd-41ba-b0b7-f42fc27af603" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.197088] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.197398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.197398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.197541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.197627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.197835] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.197931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.198013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.198161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.198262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.198408] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfefe395-d857-43f0-952f-7a8984da2f70 already deleted. [ 658.198568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.217298] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.218041] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-512" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.218041] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-512" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.218041] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-512" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.218232] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.218428] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.218490] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.218673] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.218815] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.219025] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.219135] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.219235] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.219521] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.219521] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.219521] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.219712] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.241193] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.241193] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.241193] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.241564] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-512" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.241712] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-b864ba11-d1e8-4661-ae42-beb302897c61 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.241871] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-b864ba11-d1e8-4661-ae42-beb302897c61" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.241985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-b864ba11-d1e8-4661-ae42-beb302897c61" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.242451] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-b864ba11-d1e8-4661-ae42-beb302897c61" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.242953] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b864ba11-d1e8-4661-ae42-beb302897c61',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.430034] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.430034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.430299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.430347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.430412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.430510] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08ed6a18-afa2-4545-884c-6065de6a6744 already deleted. [ 658.430594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08ed6a18-afa2-4545-884c-6065de6a6744" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.439433] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.745206] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.745443] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.745944] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.745944] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.746115] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.746166] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port b864ba11-d1e8-4661-ae42-beb302897c61 not found, creating... [ 658.746535] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.746775] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.746832] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.747092] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.749052] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.749052] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.749052] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.749052] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.749052] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.749052] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.749658] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: b864ba11-d1e8-4661-ae42-beb302897c61 is going to be created. [ 658.776036] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.776036] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.776036] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.776362] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.777552] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.777552] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-b864ba11-d1e8-4661-ae42-beb302897c61" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.942814] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.942814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.942814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.942814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.942814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.942814] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5850b07-8815-476d-8023-18db057487e0 is going to be created. [ 658.975999] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.975999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.975999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.975999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.975999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.986232] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5850b07-8815-476d-8023-18db057487e0 in Status: UNINITIALIZED for 2s [ 659.096742] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: SUCCESS [ 659.096924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.621532] env[65553]: INFO networking_nsxv3.common.synchronization [req-db8b46ee-f69a-42a0-be0b-a5676cb3dae7 req-1d632b1d-3d73-49e7-82ed-c13f32957b63 service nova] Enqueued Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_rules [ 659.621853] env[65553]: INFO networking_nsxv3.common.synchronization [req-db8b46ee-f69a-42a0-be0b-a5676cb3dae7 req-1d632b1d-3d73-49e7-82ed-c13f32957b63 service nova] Enqueued Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 659.621853] env[65553]: INFO networking_nsxv3.common.synchronization [req-db8b46ee-f69a-42a0-be0b-a5676cb3dae7 req-1d632b1d-3d73-49e7-82ed-c13f32957b63 service nova] Enqueued Resource ID: b864ba11-d1e8-4661-ae42-beb302897c61 with Priority: HIGHEST for action port [ 659.622848] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_rules [ 659.622848] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 659.623760] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b864ba11-d1e8-4661-ae42-beb302897c61 with Priority: HIGHEST for action port [ 659.623760] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.623760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.624091] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.624127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.624221] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.625775] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.625899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.625966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.626166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.626333] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.626433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.626497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.626663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.626783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.626872] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.628444] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-b864ba11-d1e8-4661-ae42-beb302897c61 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.628444] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b864ba11-d1e8-4661-ae42-beb302897c61" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.628444] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b864ba11-d1e8-4661-ae42-beb302897c61" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.629016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b864ba11-d1e8-4661-ae42-beb302897c61" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.629016] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b864ba11-d1e8-4661-ae42-beb302897c61',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.126414] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.126629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.132813] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b864ba11-d1e8-4661-ae42-beb302897c61 with status ACTIVE [ 660.133046] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.133212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.133540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.133540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.133675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.133857] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.133962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.134042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.134193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.134310] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.134526] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.134610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.134647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.134792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.134882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.134965] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b864ba11-d1e8-4661-ae42-beb302897c61 is going to be updated. [ 660.139028] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.164293] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.164293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.164293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.164293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.164293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.164293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b864ba11-d1e8-4661-ae42-beb302897c61" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.641433] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.004028] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5850b07-8815-476d-8023-18db057487e0 in Status: SUCCESS [ 661.004028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.004028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.004028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.004028] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.004028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.004028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.004028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.004028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.004028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.004028] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.148835] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.148835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.148835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.148835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.148835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.148835] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfefe395-d857-43f0-952f-7a8984da2f70 is going to be created. [ 661.177608] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.177823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.177907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.178075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.178272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.189430] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: UNINITIALIZED for 2s [ 661.506175] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.008160] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5850b07-8815-476d-8023-18db057487e0: rpc.has_security_group_logging(os_id): False [ 662.030713] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.030713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.030713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.030713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.031460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.038149] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.038149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.038149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.038149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.038149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.038149] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5850b07-8815-476d-8023-18db057487e0 is going to be created. [ 662.111489] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.111489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.111489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.111747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.111862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.124127] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5850b07-8815-476d-8023-18db057487e0 in Status: IN_PROGRESS for 2s [ 662.700030] env[65553]: INFO networking_nsxv3.common.synchronization [req-4c14bd4c-2abf-4e46-9e39-3432e2accdc5 req-e898e224-8723-440d-b075-462e7ec1fbc0 tempest-SecurityGroupRulesTestJSON-49115618 tempest-SecurityGroupRulesTestJSON-49115618-project-member] Enqueued Resource ID: cb169acc-8f94-4a95-b371-205c351edd9c with Priority: HIGHEST for action security_group_rules [ 662.701568] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb169acc-8f94-4a95-b371-205c351edd9c with Priority: HIGHEST for action security_group_rules [ 662.702352] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb169acc-8f94-4a95-b371-205c351edd9c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.702767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb169acc-8f94-4a95-b371-205c351edd9c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.704518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb169acc-8f94-4a95-b371-205c351edd9c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.704518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb169acc-8f94-4a95-b371-205c351edd9c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.704518] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb169acc-8f94-4a95-b371-205c351edd9c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.201506] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: SUCCESS [ 663.201506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.201506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.201506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.202177] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.202177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.203279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.203279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.203822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.203822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.203822] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.230190] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.232135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.232135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.232135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.232135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.232135] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb169acc-8f94-4a95-b371-205c351edd9c already deleted. [ 663.232135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb169acc-8f94-4a95-b371-205c351edd9c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.707420] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.707632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.707711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.707876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.708080] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.708203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.708250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.708454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.708537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.708625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.708791] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.708906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.708958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.709135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.709317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.709459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.709459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.709561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.709670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.709717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.710122] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.065139] env[65553]: INFO networking_nsxv3.common.synchronization [req-9017a189-2a18-4ad9-8f9c-739dcfea2dd6 req-8ad08680-62d0-486d-8856-b0c45f3510fe tempest-SecurityGroupRulesNegativeTestJSON-119005519 tempest-SecurityGroupRulesNegativeTestJSON-119005519-project-member] Enqueued Resource ID: 08ed6a18-afa2-4545-884c-6065de6a6744 with Priority: HIGHEST for action security_group_rules [ 664.065870] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08ed6a18-afa2-4545-884c-6065de6a6744 with Priority: HIGHEST for action security_group_rules [ 664.066060] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08ed6a18-afa2-4545-884c-6065de6a6744 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.066189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08ed6a18-afa2-4545-884c-6065de6a6744" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.066253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08ed6a18-afa2-4545-884c-6065de6a6744" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.066446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08ed6a18-afa2-4545-884c-6065de6a6744" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.066542] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08ed6a18-afa2-4545-884c-6065de6a6744',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.234641] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfefe395-d857-43f0-952f-7a8984da2f70: rpc.has_security_group_logging(os_id): False [ 664.254149] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5850b07-8815-476d-8023-18db057487e0 in Status: SUCCESS [ 664.254149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.257201] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.257467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.257467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.257627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.257712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.257941] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.258061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.258115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.258251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.258334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.258500] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.258654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.258654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.259033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.259033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.259112] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.259177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.259251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.260095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.260095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.260095] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfefe395-d857-43f0-952f-7a8984da2f70 is going to be created. [ 664.322086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.322764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.322764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.322944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.323240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.336234] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: IN_PROGRESS for 2s [ 664.758023] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.758023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.758023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.758023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.758023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.758023] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08ed6a18-afa2-4545-884c-6065de6a6744 already deleted. [ 664.758023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08ed6a18-afa2-4545-884c-6065de6a6744" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.630356] env[65553]: INFO networking_nsxv3.common.synchronization [req-05e54341-dc6f-4f17-bdd4-d1ed001ff569 req-c363c5c8-4794-4de1-a221-d7939dea741d tempest-DeleteServersAdminTestJSON-651714207 tempest-DeleteServersAdminTestJSON-651714207-project-member] Enqueued Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 665.630356] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGHEST for action security_group_members [ 665.634239] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.634471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.634592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.634882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.635086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.635208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.635279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.635514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.635641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.635729] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.138271] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.138567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.138567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.138877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.138877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.139364] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.139511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.139703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.139911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.139998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.140392] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 is going to be updated. [ 666.174886] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.175425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.175425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.175425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.175580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.186472] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: IN_PROGRESS for 2s [ 666.352099] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: SUCCESS [ 666.352481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.037228] env[65553]: INFO networking_nsxv3.common.synchronization [None req-16f3f477-96c2-47f5-a679-6d311acf109f None None] Enqueued Resource ID: 440ceeba-a56f-47c4-bffb-bfe401ac16c6 with Priority: HIGHEST for action port [ 667.039024] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440ceeba-a56f-47c4-bffb-bfe401ac16c6 with Priority: HIGHEST for action port [ 667.039389] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-440ceeba-a56f-47c4-bffb-bfe401ac16c6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.039529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-440ceeba-a56f-47c4-bffb-bfe401ac16c6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.039594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-440ceeba-a56f-47c4-bffb-bfe401ac16c6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.039861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-440ceeba-a56f-47c4-bffb-bfe401ac16c6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.039943] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('440ceeba-a56f-47c4-bffb-bfe401ac16c6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.544278] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 440ceeba-a56f-47c4-bffb-bfe401ac16c6 [ 667.544278] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.544278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.544278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.544278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.544278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.544278] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:440ceeba-a56f-47c4-bffb-bfe401ac16c6 already deleted. [ 667.544278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-440ceeba-a56f-47c4-bffb-bfe401ac16c6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.198351] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edac77c9-fa82-4dc9-b52a-a8a880305683 in Status: SUCCESS [ 668.198606] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 deletion is rescheduled due to dependency. [ 668.198606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.808478] env[65553]: INFO networking_nsxv3.common.synchronization [None req-ace60d3e-bbb2-4c0c-b58a-6e1aab0b69bf None None] Enqueued Resource ID: 82c5c591-d1d1-4f07-9d4d-d1b805687fb9 with Priority: HIGHEST for action port [ 668.808973] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c5c591-d1d1-4f07-9d4d-d1b805687fb9 with Priority: HIGHEST for action port [ 668.809354] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-82c5c591-d1d1-4f07-9d4d-d1b805687fb9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.809511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82c5c591-d1d1-4f07-9d4d-d1b805687fb9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.809586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82c5c591-d1d1-4f07-9d4d-d1b805687fb9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.809947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82c5c591-d1d1-4f07-9d4d-d1b805687fb9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.810015] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c5c591-d1d1-4f07-9d4d-d1b805687fb9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.951403] env[65553]: INFO networking_nsxv3.common.synchronization [None req-666e6ae4-54e6-453e-9a6d-bbe5cd587591 None None] Enqueued Resource ID: 8dd430c3-e282-4825-883c-b5bc7fb3b079 with Priority: HIGHEST for action port [ 668.951971] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dd430c3-e282-4825-883c-b5bc7fb3b079 with Priority: HIGHEST for action port [ 668.952406] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dd430c3-e282-4825-883c-b5bc7fb3b079 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.952513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dd430c3-e282-4825-883c-b5bc7fb3b079" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.952513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dd430c3-e282-4825-883c-b5bc7fb3b079" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.952771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dd430c3-e282-4825-883c-b5bc7fb3b079" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.952858] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd430c3-e282-4825-883c-b5bc7fb3b079',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.117929] env[65553]: INFO networking_nsxv3.common.synchronization [req-e98712f0-4d73-43c5-a9de-2580ee5763a8 req-a1c3b5d9-7a44-4336-95c7-2cb7c6255a68 tempest-ServerDiagnosticsNegativeTest-25065579 tempest-ServerDiagnosticsNegativeTest-25065579-project-member] Enqueued Resource ID: de664cf7-0945-48b8-9372-6d843b23be0e with Priority: HIGHEST for action security_group_members [ 669.120743] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de664cf7-0945-48b8-9372-6d843b23be0e with Priority: HIGHEST for action security_group_members [ 669.122027] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-de664cf7-0945-48b8-9372-6d843b23be0e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.122027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.122027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.122308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.122308] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.122499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.122499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.122650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.122696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.122797] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de664cf7-0945-48b8-9372-6d843b23be0e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.314677] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82c5c591-d1d1-4f07-9d4d-d1b805687fb9 [ 669.314990] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.315167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.315239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.315506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.315630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.315740] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82c5c591-d1d1-4f07-9d4d-d1b805687fb9 already deleted. [ 669.315825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82c5c591-d1d1-4f07-9d4d-d1b805687fb9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.457685] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dd430c3-e282-4825-883c-b5bc7fb3b079 [ 669.458250] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.458628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.458717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.460850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.460850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.460850] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dd430c3-e282-4825-883c-b5bc7fb3b079 already deleted. [ 669.460850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dd430c3-e282-4825-883c-b5bc7fb3b079" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.625920] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.626192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.626263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.626524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.626641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.626833] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.626934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.626993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.627173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.627244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.627329] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de664cf7-0945-48b8-9372-6d843b23be0e is going to be updated. [ 669.665293] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.668535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.668535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.668535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.668535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.677659] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de664cf7-0945-48b8-9372-6d843b23be0e in Status: IN_PROGRESS for 2s [ 669.802660] env[65553]: INFO networking_nsxv3.common.synchronization [req-2d531e25-8e7c-421b-9b84-c20af47f8be0 req-4fe3b03f-c71d-431f-affd-d162067d76af tempest-ImagesTestJSON-1118693169 tempest-ImagesTestJSON-1118693169-project-member] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 669.803224] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 669.803556] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.804141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.804254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.804494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.804676] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.804806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.804889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.805496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.805642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.805762] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.307973] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.308590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.309278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.309540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.309644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.309883] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.309995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.310069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.310259] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.310341] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.310430] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 670.357380] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.357961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.357961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.358243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.358889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.371029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 670.635470] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.635695] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.635804] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.636074] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.636329] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.636476] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.636585] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.636826] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.637201] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.637201] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.637320] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.637380] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.637681] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.637681] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.637681] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.637784] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.672649] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.672839] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.672941] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.673474] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.673665] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-172cae28-8ba0-47ff-9a81-ebe01c02b729 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.673788] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-172cae28-8ba0-47ff-9a81-ebe01c02b729" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.673906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-172cae28-8ba0-47ff-9a81-ebe01c02b729" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.674549] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-172cae28-8ba0-47ff-9a81-ebe01c02b729" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.674549] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('172cae28-8ba0-47ff-9a81-ebe01c02b729',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.178160] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.179013] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.179200] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.179540] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.179710] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.179932] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 172cae28-8ba0-47ff-9a81-ebe01c02b729 not found, creating... [ 671.180257] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.181407] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.181407] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.181407] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.181407] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.182308] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.182626] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.182854] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.183159] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.183372] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.183647] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 172cae28-8ba0-47ff-9a81-ebe01c02b729 is going to be created. [ 671.212789] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.212978] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.213095] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.213369] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.213588] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.213905] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-172cae28-8ba0-47ff-9a81-ebe01c02b729" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.295643] env[65553]: INFO networking_nsxv3.common.synchronization [req-1ec6e6ca-1b00-4861-9cd3-61590f9f7ce4 req-b4b179a3-42a9-4b3a-a171-1526113fc8b8 tempest-FloatingIPsAssociationNegativeTestJSON-1299180993 tempest-FloatingIPsAssociationNegativeTestJSON-1299180993-project-member] Enqueued Resource ID: b5b58f96-24da-4b03-965a-558253f0ed7f with Priority: HIGHEST for action security_group_members [ 671.296430] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b58f96-24da-4b03-965a-558253f0ed7f with Priority: HIGHEST for action security_group_members [ 671.296774] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b58f96-24da-4b03-965a-558253f0ed7f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.298099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.298099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.298099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.298099] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.298099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.298099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.298099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.298950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.298950] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b58f96-24da-4b03-965a-558253f0ed7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.577606] env[65553]: INFO networking_nsxv3.common.synchronization [None req-a7195d9c-45b6-494a-ba83-45b8a8817b75 None None] Enqueued Resource ID: 5e1350c5-48b4-47ac-93f7-51c691644ee8 with Priority: HIGHEST for action port [ 671.577926] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e1350c5-48b4-47ac-93f7-51c691644ee8 with Priority: HIGHEST for action port [ 671.578704] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e1350c5-48b4-47ac-93f7-51c691644ee8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.578704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e1350c5-48b4-47ac-93f7-51c691644ee8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.578870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e1350c5-48b4-47ac-93f7-51c691644ee8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.579102] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e1350c5-48b4-47ac-93f7-51c691644ee8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.579196] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e1350c5-48b4-47ac-93f7-51c691644ee8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.690216] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de664cf7-0945-48b8-9372-6d843b23be0e in Status: SUCCESS [ 671.691199] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de664cf7-0945-48b8-9372-6d843b23be0e deletion is rescheduled due to dependency. [ 671.691199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.802160] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.802160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.802160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.802160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.802616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.802616] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.802845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.802845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.802951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.802951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.803202] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b58f96-24da-4b03-965a-558253f0ed7f already deleted. [ 671.803366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.804302] env[65553]: INFO networking_nsxv3.common.synchronization [None req-c3acd943-6454-44ba-96c3-6baaf64edb6e None None] Enqueued Resource ID: 725ba4a7-214d-428d-af9b-642112aadebe with Priority: HIGHEST for action port [ 671.805060] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725ba4a7-214d-428d-af9b-642112aadebe with Priority: HIGHEST for action port [ 671.805421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-725ba4a7-214d-428d-af9b-642112aadebe taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.805585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-725ba4a7-214d-428d-af9b-642112aadebe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.805681] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-725ba4a7-214d-428d-af9b-642112aadebe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.806465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-725ba4a7-214d-428d-af9b-642112aadebe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.806465] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('725ba4a7-214d-428d-af9b-642112aadebe',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.960800] env[65553]: INFO networking_nsxv3.common.synchronization [req-2d531e25-8e7c-421b-9b84-c20af47f8be0 req-90d69615-dac8-4419-9d3b-08b7c51a696b service nova] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_rules [ 671.960977] env[65553]: INFO networking_nsxv3.common.synchronization [req-2d531e25-8e7c-421b-9b84-c20af47f8be0 req-90d69615-dac8-4419-9d3b-08b7c51a696b service nova] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 671.961464] env[65553]: INFO networking_nsxv3.common.synchronization [req-2d531e25-8e7c-421b-9b84-c20af47f8be0 req-90d69615-dac8-4419-9d3b-08b7c51a696b service nova] Enqueued Resource ID: 172cae28-8ba0-47ff-9a81-ebe01c02b729 with Priority: HIGHEST for action port [ 671.962149] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_rules [ 671.963222] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 671.963222] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 172cae28-8ba0-47ff-9a81-ebe01c02b729 with Priority: HIGHEST for action port [ 671.963505] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.963628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.963707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.963973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.964070] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.965355] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.965463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.965682] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-172cae28-8ba0-47ff-9a81-ebe01c02b729 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.965829] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-172cae28-8ba0-47ff-9a81-ebe01c02b729" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.965950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-172cae28-8ba0-47ff-9a81-ebe01c02b729" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.966188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-172cae28-8ba0-47ff-9a81-ebe01c02b729" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.966272] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('172cae28-8ba0-47ff-9a81-ebe01c02b729',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.080947] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e1350c5-48b4-47ac-93f7-51c691644ee8 [ 672.082183] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.082183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.082183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.082183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.082183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.082183] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e1350c5-48b4-47ac-93f7-51c691644ee8 already deleted. [ 672.082183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e1350c5-48b4-47ac-93f7-51c691644ee8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.308425] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 725ba4a7-214d-428d-af9b-642112aadebe [ 672.308810] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.308810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.309034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.309133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.309202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.309271] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:725ba4a7-214d-428d-af9b-642112aadebe already deleted. [ 672.309348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-725ba4a7-214d-428d-af9b-642112aadebe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.381590] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 672.381761] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 deletion is rescheduled due to dependency. [ 672.381875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.382050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.382272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.382549] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.382668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.382730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.382956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.383055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.383151] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.386014] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-494 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.386221] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-494" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.386339] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-494" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.387090] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-494" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.387451] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.387451] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.387591] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.387761] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.387920] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.388813] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.388988] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.389132] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.389247] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.389676] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.389839] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.390035] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.427895] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.427895] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.427895] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.427895] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-494" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.428078] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-7ed495af-2787-4616-a0ba-815228ff88b8 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.428158] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-7ed495af-2787-4616-a0ba-815228ff88b8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.428216] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-7ed495af-2787-4616-a0ba-815228ff88b8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.428573] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-7ed495af-2787-4616-a0ba-815228ff88b8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.428729] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ed495af-2787-4616-a0ba-815228ff88b8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.469333] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.469333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.472131] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 172cae28-8ba0-47ff-9a81-ebe01c02b729 with status ACTIVE [ 672.472131] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.472131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.472131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.472131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.472577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.472577] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.472577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.472694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.474454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.474454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.474454] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.474454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.474454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.474454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.474454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.474454] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 172cae28-8ba0-47ff-9a81-ebe01c02b729 is going to be updated. [ 672.508374] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.508602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.508602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.508804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.508940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.509117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-172cae28-8ba0-47ff-9a81-ebe01c02b729" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.892277] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.902747] env[65553]: INFO networking_nsxv3.common.synchronization [None req-6c26edfc-e42b-42cc-ad3d-f45ca5a33b2d None None] Enqueued Resource ID: a52a807a-23b5-48dc-b3de-d72b55557348 with Priority: HIGHEST for action port [ 672.903583] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a52a807a-23b5-48dc-b3de-d72b55557348 with Priority: HIGHEST for action port [ 672.904127] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-a52a807a-23b5-48dc-b3de-d72b55557348 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.904444] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a52a807a-23b5-48dc-b3de-d72b55557348" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.904621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a52a807a-23b5-48dc-b3de-d72b55557348" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.905114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a52a807a-23b5-48dc-b3de-d72b55557348" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.905114] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a52a807a-23b5-48dc-b3de-d72b55557348',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.932749] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.932749] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.932749] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.932749] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.932749] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.933109] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 7ed495af-2787-4616-a0ba-815228ff88b8 not found, creating... [ 672.933152] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.934273] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.934273] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.934273] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.934273] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.934273] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.934273] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.934273] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.934879] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.934879] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.934879] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 7ed495af-2787-4616-a0ba-815228ff88b8 is going to be created. [ 672.962024] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.962248] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.962440] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.962704] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.962930] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.963208] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-7ed495af-2787-4616-a0ba-815228ff88b8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.396277] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.410969] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a52a807a-23b5-48dc-b3de-d72b55557348 [ 673.410969] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.410969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.410969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.410969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.410969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.410969] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a52a807a-23b5-48dc-b3de-d72b55557348 already deleted. [ 673.410969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a52a807a-23b5-48dc-b3de-d72b55557348" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.678032] env[65553]: INFO networking_nsxv3.common.synchronization [req-1ec6e6ca-1b00-4861-9cd3-61590f9f7ce4 req-f66a7a5a-3b09-4163-8587-8d472e7c29d7 service nova] Enqueued Resource ID: b5b58f96-24da-4b03-965a-558253f0ed7f with Priority: HIGHEST for action security_group_rules [ 673.678032] env[65553]: INFO networking_nsxv3.common.synchronization [req-1ec6e6ca-1b00-4861-9cd3-61590f9f7ce4 req-f66a7a5a-3b09-4163-8587-8d472e7c29d7 service nova] Enqueued Resource ID: b5b58f96-24da-4b03-965a-558253f0ed7f with Priority: HIGHEST for action security_group_members [ 673.678169] env[65553]: INFO networking_nsxv3.common.synchronization [req-1ec6e6ca-1b00-4861-9cd3-61590f9f7ce4 req-f66a7a5a-3b09-4163-8587-8d472e7c29d7 service nova] Enqueued Resource ID: 7ed495af-2787-4616-a0ba-815228ff88b8 with Priority: HIGHEST for action port [ 673.678756] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b58f96-24da-4b03-965a-558253f0ed7f with Priority: HIGHEST for action security_group_rules [ 673.678756] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b58f96-24da-4b03-965a-558253f0ed7f with Priority: HIGHEST for action security_group_members [ 673.678756] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed495af-2787-4616-a0ba-815228ff88b8 with Priority: HIGHEST for action port [ 673.679182] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b58f96-24da-4b03-965a-558253f0ed7f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.679307] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.679391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.679664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.679726] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b58f96-24da-4b03-965a-558253f0ed7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.680501] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b58f96-24da-4b03-965a-558253f0ed7f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.680807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.680807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.680898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.681352] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.681352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.681352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.681352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.681352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.681819] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b58f96-24da-4b03-965a-558253f0ed7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.682966] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ed495af-2787-4616-a0ba-815228ff88b8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.683346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ed495af-2787-4616-a0ba-815228ff88b8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.683346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ed495af-2787-4616-a0ba-815228ff88b8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.683346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ed495af-2787-4616-a0ba-815228ff88b8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.683346] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ed495af-2787-4616-a0ba-815228ff88b8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.900246] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.900638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.900638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.900770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.901033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.901033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 673.936959] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.936959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.936959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.936959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.936959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.946184] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 674.096345] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-36034f9f-ef72-43d9-b2cc-82fb7f2ec220 tempest-ListServersNegativeTestJSON-1035197214 tempest-ListServersNegativeTestJSON-1035197214-project-member] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 674.097380] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 674.098184] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.098321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.098411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.098692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.098865] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.098967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.099051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.099207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.099847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.099847] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.191183] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5b58f96-24da-4b03-965a-558253f0ed7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.191183] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b58f96-24da-4b03-965a-558253f0ed7f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.191183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.191183] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ed495af-2787-4616-a0ba-815228ff88b8 with status ACTIVE [ 674.191183] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.191183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.191183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.191183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.191183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.191183] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.191183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.191183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.191183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.191183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.191791] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.191791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.191791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.191791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.191791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.191791] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ed495af-2787-4616-a0ba-815228ff88b8 is going to be updated. [ 674.226576] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.226773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.226773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.226965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.227695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.227695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ed495af-2787-4616-a0ba-815228ff88b8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.549104] env[65553]: INFO networking_nsxv3.common.synchronization [None req-5420b7db-7c4e-47a6-911e-c45c8a0cf09a None None] Enqueued Resource ID: fcd30097-31bb-4c76-93cb-6f84215942dd with Priority: HIGHEST for action port [ 674.550132] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcd30097-31bb-4c76-93cb-6f84215942dd with Priority: HIGHEST for action port [ 674.550855] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcd30097-31bb-4c76-93cb-6f84215942dd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.550855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcd30097-31bb-4c76-93cb-6f84215942dd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.550855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcd30097-31bb-4c76-93cb-6f84215942dd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.551129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcd30097-31bb-4c76-93cb-6f84215942dd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.551212] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd30097-31bb-4c76-93cb-6f84215942dd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.604055] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.604055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.604055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.604055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.604055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.604055] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.607055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.607055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.607055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.607055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.607055] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be already deleted. [ 674.607306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.659669] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.659861] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.659986] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.660340] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.660623] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.660743] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.660852] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.661083] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.661223] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.661427] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.661534] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.661646] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.661795] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.662122] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.662178] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.662324] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.682540] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.682733] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.682779] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.682942] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.683339] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-1456d08f-1d97-43fd-8dc4-6735bc7145f9 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.683514] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-1456d08f-1d97-43fd-8dc4-6735bc7145f9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.683625] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-1456d08f-1d97-43fd-8dc4-6735bc7145f9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.683943] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-1456d08f-1d97-43fd-8dc4-6735bc7145f9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.684103] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1456d08f-1d97-43fd-8dc4-6735bc7145f9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.696198] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5b58f96-24da-4b03-965a-558253f0ed7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.744918] env[65553]: INFO networking_nsxv3.common.synchronization [None req-fbc760c4-de6a-486c-b9f2-7d741e0a6d0d tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_rules [ 674.745467] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_rules [ 674.745800] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.745971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.746029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.746265] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.746349] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.058421] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fcd30097-31bb-4c76-93cb-6f84215942dd [ 675.060172] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.060172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.060172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.060172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.060172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.060172] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fcd30097-31bb-4c76-93cb-6f84215942dd already deleted. [ 675.060172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcd30097-31bb-4c76-93cb-6f84215942dd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.186836] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.187081] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.187190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.187493] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.187602] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.187750] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 1456d08f-1d97-43fd-8dc4-6735bc7145f9 not found, creating... [ 675.188062] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.188204] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.188329] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.188536] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.188664] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.188929] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.189096] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.189207] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.189406] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.189554] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.189701] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 1456d08f-1d97-43fd-8dc4-6735bc7145f9 is going to be created. [ 675.199785] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.200041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.200041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.200226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.200297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.200394] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b58f96-24da-4b03-965a-558253f0ed7f is going to be created. [ 675.218311] env[65553]: INFO networking_nsxv3.common.synchronization [None req-ad726f63-e058-44bc-ad20-f9aa1a86874e tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_rules [ 675.218818] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_rules [ 675.219140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.219241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.229362] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.229568] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.229719] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.230029] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.230257] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.230477] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-1456d08f-1d97-43fd-8dc4-6735bc7145f9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.266785] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.266956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.266956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.267244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.267422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.278173] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b58f96-24da-4b03-965a-558253f0ed7f in Status: UNINITIALIZED for 2s [ 675.279496] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.279762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.279865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.280172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.280417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.280507] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 already deleted. [ 675.280635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.280838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.281263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.281401] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.809351] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.809351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.809351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.809351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.809351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.809841] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 already deleted. [ 675.809841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.846719] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f5977dc8-4165-4906-a0f5-c62a551cfb79 None None] Enqueued Resource ID: 630453ed-eaac-4066-89f3-354f89eecbd2 with Priority: HIGHEST for action port [ 675.847246] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 630453ed-eaac-4066-89f3-354f89eecbd2 with Priority: HIGHEST for action port [ 675.847648] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-630453ed-eaac-4066-89f3-354f89eecbd2 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.847833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-630453ed-eaac-4066-89f3-354f89eecbd2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.848052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-630453ed-eaac-4066-89f3-354f89eecbd2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.848197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-630453ed-eaac-4066-89f3-354f89eecbd2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.848283] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('630453ed-eaac-4066-89f3-354f89eecbd2',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.931243] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-32b9ba1f-9e11-4e8e-b0ea-6519e107dfdd service nova] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_rules [ 675.931243] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-32b9ba1f-9e11-4e8e-b0ea-6519e107dfdd service nova] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 675.931243] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-32b9ba1f-9e11-4e8e-b0ea-6519e107dfdd service nova] Enqueued Resource ID: 1456d08f-1d97-43fd-8dc4-6735bc7145f9 with Priority: HIGHEST for action port [ 675.931743] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_rules [ 675.932478] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 675.932478] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1456d08f-1d97-43fd-8dc4-6735bc7145f9 with Priority: HIGHEST for action port [ 675.932720] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.932846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.932910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.933211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.933286] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.934198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.934261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.934299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.934704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.934803] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.934936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.934996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.935152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.935329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.935329] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.936187] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-1456d08f-1d97-43fd-8dc4-6735bc7145f9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.936308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1456d08f-1d97-43fd-8dc4-6735bc7145f9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.936381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1456d08f-1d97-43fd-8dc4-6735bc7145f9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.936517] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1456d08f-1d97-43fd-8dc4-6735bc7145f9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.936590] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1456d08f-1d97-43fd-8dc4-6735bc7145f9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.959097] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 675.959304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.959457] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.960030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.960030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.960030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.960233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.960285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.960367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.960454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.960576] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.255291] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-9825c5dc-b62d-47b7-bf9b-2824cc55fb2b tempest-ListServersNegativeTestJSON-1035197214 tempest-ListServersNegativeTestJSON-1035197214-project-member] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 676.255873] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 676.256360] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.256360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.353528] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 630453ed-eaac-4066-89f3-354f89eecbd2 [ 676.353528] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.353528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.353528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.353528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.353528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.353528] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:630453ed-eaac-4066-89f3-354f89eecbd2 already deleted. [ 676.353528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-630453ed-eaac-4066-89f3-354f89eecbd2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.442074] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.442074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.442074] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.442074] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1456d08f-1d97-43fd-8dc4-6735bc7145f9 with status ACTIVE [ 676.442074] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.442074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.442074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.442074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.442074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.442074] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.442074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.442074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.443711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.446422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.446422] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.446422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.446422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.447880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.447880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.447880] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1456d08f-1d97-43fd-8dc4-6735bc7145f9 is going to be updated. [ 676.464073] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.464354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.464354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.464632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.464814] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.464943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.465110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.465283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.465366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.465632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.465748] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.465853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.465915] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.466396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.466609] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.466724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.466782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.466934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.467120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.467213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.467306] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.481268] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.481484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.481630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.481740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.481875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.482069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1456d08f-1d97-43fd-8dc4-6735bc7145f9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.773288] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.773288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.773288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.773288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.773288] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.773288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.773288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.773886] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.774137] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.774478] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.774702] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 676.774898] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 676.775095] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 676.775708] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.775977] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 676.776219] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 676.797771] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 676.797771] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 676.797771] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 676.797771] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.797771] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-cdc36b93-58cf-40b2-b8a8-1c4c8c01b556 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.797771] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-cdc36b93-58cf-40b2-b8a8-1c4c8c01b556" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.797771] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-cdc36b93-58cf-40b2-b8a8-1c4c8c01b556" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.797771] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-cdc36b93-58cf-40b2-b8a8-1c4c8c01b556" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.797771] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdc36b93-58cf-40b2-b8a8-1c4c8c01b556',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.951614] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.971457] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15032a54-f6e7-41b8-855b-0262e8fb39c5: rpc.has_security_group_logging(os_id): False [ 676.989897] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.990210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.990210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.990438] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.990583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.990903] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.991414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.991414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.991414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.991656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.991656] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.991793] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.991848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.992073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.992073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.992221] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.992303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.992385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.992534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.992624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.992727] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 677.066057] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.066057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.066057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.066057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.066057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.080743] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 677.239776] env[65553]: INFO networking_nsxv3.common.synchronization [None req-b93f9975-6c7c-4a36-a53e-303ce373067a None None] Enqueued Resource ID: d49902a8-d87d-4c8d-b404-e96c26c20a14 with Priority: HIGHEST for action port [ 677.240385] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49902a8-d87d-4c8d-b404-e96c26c20a14 with Priority: HIGHEST for action port [ 677.240712] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d49902a8-d87d-4c8d-b404-e96c26c20a14 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.240841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d49902a8-d87d-4c8d-b404-e96c26c20a14" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.240897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d49902a8-d87d-4c8d-b404-e96c26c20a14" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.241177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d49902a8-d87d-4c8d-b404-e96c26c20a14" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.241262] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d49902a8-d87d-4c8d-b404-e96c26c20a14',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.291456] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b58f96-24da-4b03-965a-558253f0ed7f in Status: SUCCESS [ 677.291456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.291456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.291456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.291944] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.291944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.291944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.292198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.292198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.292287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.292817] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5b58f96-24da-4b03-965a-558253f0ed7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.302419] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.302419] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.302419] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.302805] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.303103] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.303306] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port cdc36b93-58cf-40b2-b8a8-1c4c8c01b556 not found, creating... [ 677.305892] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.306692] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.307866] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.307866] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.308066] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.309029] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.309215] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.309639] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.310179] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.310396] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.311054] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: cdc36b93-58cf-40b2-b8a8-1c4c8c01b556 is going to be created. [ 677.336025] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.336237] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.336353] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.336764] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.336863] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.337101] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-cdc36b93-58cf-40b2-b8a8-1c4c8c01b556" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.453256] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.453466] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.453512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.453697] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.453787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.453885] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be created. [ 677.482053] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.482198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.482278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.482520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.482687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.495884] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: UNINITIALIZED for 2s [ 677.743877] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d49902a8-d87d-4c8d-b404-e96c26c20a14 [ 677.744126] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.746029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.746029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.746029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.746029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.746029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d49902a8-d87d-4c8d-b404-e96c26c20a14 already deleted. [ 677.746029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d49902a8-d87d-4c8d-b404-e96c26c20a14" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.796152] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b58f96-24da-4b03-965a-558253f0ed7f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.796996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.797190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.797655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.797957] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.798177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.798677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.798902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.802168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.802289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.802496] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b58f96-24da-4b03-965a-558253f0ed7f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.802607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.802671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.802867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.806252] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.806252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.806252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.806252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.806252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.806252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.806252] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5b58f96-24da-4b03-965a-558253f0ed7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.898064] env[65553]: INFO networking_nsxv3.common.synchronization [req-935c7690-b363-4a0b-ba5c-df38787d054f req-dec06094-8a90-4f7c-aa10-57ad468708ee tempest-SecurityGroupRulesTestJSON-49115618 tempest-SecurityGroupRulesTestJSON-49115618-project-member] Enqueued Resource ID: ffc2a28c-eec7-40f5-8a6f-f361579a5635 with Priority: HIGHEST for action security_group_rules [ 677.898704] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc2a28c-eec7-40f5-8a6f-f361579a5635 with Priority: HIGHEST for action security_group_rules [ 677.899051] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffc2a28c-eec7-40f5-8a6f-f361579a5635 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.899206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffc2a28c-eec7-40f5-8a6f-f361579a5635" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.899289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffc2a28c-eec7-40f5-8a6f-f361579a5635" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.899559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffc2a28c-eec7-40f5-8a6f-f361579a5635" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.899662] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffc2a28c-eec7-40f5-8a6f-f361579a5635',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.093259] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-f04394aa-1e28-4f6b-a3fd-67b3ab711020 service nova] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_rules [ 678.093417] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-f04394aa-1e28-4f6b-a3fd-67b3ab711020 service nova] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 678.093689] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-f04394aa-1e28-4f6b-a3fd-67b3ab711020 service nova] Enqueued Resource ID: cdc36b93-58cf-40b2-b8a8-1c4c8c01b556 with Priority: HIGHEST for action port [ 678.095479] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_rules [ 678.095645] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 678.095824] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc36b93-58cf-40b2-b8a8-1c4c8c01b556 with Priority: HIGHEST for action port [ 678.096182] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.096356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.096750] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.097752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.097752] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdc36b93-58cf-40b2-b8a8-1c4c8c01b556 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.097752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdc36b93-58cf-40b2-b8a8-1c4c8c01b556" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.097752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdc36b93-58cf-40b2-b8a8-1c4c8c01b556" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.097752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdc36b93-58cf-40b2-b8a8-1c4c8c01b556" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.097987] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdc36b93-58cf-40b2-b8a8-1c4c8c01b556',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.205896] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-0f17df44-79db-4bff-81a8-fefd58c70c12 tempest-ListServersNegativeTestJSON-1035197214 tempest-ListServersNegativeTestJSON-1035197214-project-member] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 678.210334] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 678.210838] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.210838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.306792] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5b58f96-24da-4b03-965a-558253f0ed7f: rpc.has_security_group_logging(os_id): False [ 678.343824] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.343824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.343824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.345081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.345081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.345081] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.345081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.345081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.345824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.346423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.346423] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.347017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.350062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.350062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.350062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.350062] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.350062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.350062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.350062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.350062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.350062] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b58f96-24da-4b03-965a-558253f0ed7f is going to be created. [ 678.416185] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.416185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.416185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.416440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.417029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.429040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.429040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.429300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.429826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.429826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.429826] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffc2a28c-eec7-40f5-8a6f-f361579a5635 already deleted. [ 678.429826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffc2a28c-eec7-40f5-8a6f-f361579a5635" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.430846] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b58f96-24da-4b03-965a-558253f0ed7f in Status: IN_PROGRESS for 2s [ 678.603783] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdc36b93-58cf-40b2-b8a8-1c4c8c01b556 with status ACTIVE [ 678.604135] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.604635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.604635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.604743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.604812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.605018] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.606188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.606188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.606188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.606188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.606188] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.606188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.606188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.606188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.606188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.606188] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdc36b93-58cf-40b2-b8a8-1c4c8c01b556 is going to be updated. [ 678.611894] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.611894] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.611894] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.612221] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.612367] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.612569] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.612691] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.613018] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.613194] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.613433] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.613572] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.614219] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.614219] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.614219] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.614219] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.614502] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.643216] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.643380] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 678.643495] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.643675] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-279" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.643965] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-deedfc46-1660-4644-a09b-ebc02006df1b taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.645104] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-deedfc46-1660-4644-a09b-ebc02006df1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.645104] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-deedfc46-1660-4644-a09b-ebc02006df1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.646362] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-deedfc46-1660-4644-a09b-ebc02006df1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.646536] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deedfc46-1660-4644-a09b-ebc02006df1b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.648217] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.648351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.648419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.648614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.648748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.648903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdc36b93-58cf-40b2-b8a8-1c4c8c01b556" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.097825] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 679.098060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.154220] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.154596] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.154776] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.155129] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.155407] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.155513] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port deedfc46-1660-4644-a09b-ebc02006df1b not found, creating... [ 679.155695] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.155850] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.155959] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.156530] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.156530] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.156638] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.156876] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.156876] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.157189] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.157369] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.157560] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: deedfc46-1660-4644-a09b-ebc02006df1b is going to be created. [ 679.182371] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.182765] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.182907] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.183246] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.183563] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.183849] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-deedfc46-1660-4644-a09b-ebc02006df1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.508385] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 679.508701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.508841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.509051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.509348] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.509463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.509528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.509665] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.509749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.509845] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.950321] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-254d2c78-deac-41e6-b659-571e9a68e020 service nova] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_rules [ 679.950496] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-254d2c78-deac-41e6-b659-571e9a68e020 service nova] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 679.950634] env[65553]: INFO networking_nsxv3.common.synchronization [req-f9013539-71b3-4f46-aa3d-b9fe5193f413 req-254d2c78-deac-41e6-b659-571e9a68e020 service nova] Enqueued Resource ID: deedfc46-1660-4644-a09b-ebc02006df1b with Priority: HIGHEST for action port [ 679.951172] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_rules [ 679.951315] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 679.951396] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deedfc46-1660-4644-a09b-ebc02006df1b with Priority: HIGHEST for action port [ 679.951817] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.951817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.955096] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.955239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.955520] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-deedfc46-1660-4644-a09b-ebc02006df1b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.955690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deedfc46-1660-4644-a09b-ebc02006df1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.955758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deedfc46-1660-4644-a09b-ebc02006df1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.955988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deedfc46-1660-4644-a09b-ebc02006df1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.956099] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deedfc46-1660-4644-a09b-ebc02006df1b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.013328] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.450587] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5b58f96-24da-4b03-965a-558253f0ed7f in Status: SUCCESS [ 680.450841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.458328] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port deedfc46-1660-4644-a09b-ebc02006df1b with status ACTIVE [ 680.459306] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.459491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.459566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.459955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.460307] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.460392] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.460480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.460551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.460761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.460847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.461118] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.461118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.461318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.461377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.461584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.461584] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: deedfc46-1660-4644-a09b-ebc02006df1b is going to be updated. [ 680.487829] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.488081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.488220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.488568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.488690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.488870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deedfc46-1660-4644-a09b-ebc02006df1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.518578] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.881031] env[65553]: INFO networking_nsxv3.common.synchronization [None req-31023aa3-ba10-4b3b-93ac-2e27bbc12010 None None] Enqueued Resource ID: 2abf0961-2df7-4969-98fe-0a6bcee4edb0 with Priority: HIGHEST for action port [ 680.881031] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2abf0961-2df7-4969-98fe-0a6bcee4edb0 with Priority: HIGHEST for action port [ 680.881031] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2abf0961-2df7-4969-98fe-0a6bcee4edb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.881031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2abf0961-2df7-4969-98fe-0a6bcee4edb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.881031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2abf0961-2df7-4969-98fe-0a6bcee4edb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.882937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2abf0961-2df7-4969-98fe-0a6bcee4edb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.883059] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2abf0961-2df7-4969-98fe-0a6bcee4edb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.021397] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.021583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.021789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.021863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.021953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.022028] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be updated. [ 681.053255] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.054239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.054239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.054239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.054239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.072902] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 2s [ 681.385205] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2abf0961-2df7-4969-98fe-0a6bcee4edb0 [ 681.385470] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.385614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.385725] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.385929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.386058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.386145] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2abf0961-2df7-4969-98fe-0a6bcee4edb0 already deleted. [ 681.386227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2abf0961-2df7-4969-98fe-0a6bcee4edb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.087029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 683.087029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.087029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.087029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.087029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.087029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.087029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.087029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.087029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.087029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.087029] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.087780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.087780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.087883] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.087982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.088056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.088192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.088264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.088359] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.591120] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.591644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.591644] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.098401] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.605343] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.605614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.605850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.606275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.606275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.606997] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be updated. [ 684.641475] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.643852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.643852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.643852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.643852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.652848] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 2s [ 684.673057] env[65553]: INFO networking_nsxv3.common.synchronization [req-20a993f0-9597-4be6-a500-b347ce9cdd4c req-73d8f2be-e89f-47f5-8532-bf262972fe66 tempest-SecurityGroupRulesTestJSON-49115618 tempest-SecurityGroupRulesTestJSON-49115618-project-member] Enqueued Resource ID: 4f824ff8-528e-46af-8d3c-06b058183766 with Priority: HIGHEST for action security_group_rules [ 684.673254] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f824ff8-528e-46af-8d3c-06b058183766 with Priority: HIGHEST for action security_group_rules [ 684.673565] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f824ff8-528e-46af-8d3c-06b058183766 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.673679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f824ff8-528e-46af-8d3c-06b058183766" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.673740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f824ff8-528e-46af-8d3c-06b058183766" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.674142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f824ff8-528e-46af-8d3c-06b058183766" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.674142] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f824ff8-528e-46af-8d3c-06b058183766',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.194791] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.195104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.195104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.195354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.195405] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.195483] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f824ff8-528e-46af-8d3c-06b058183766 already deleted. [ 685.195545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f824ff8-528e-46af-8d3c-06b058183766" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.665167] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 686.665469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.665635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.665932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.666201] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.666367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.666470] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.666646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.666755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.666870] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.169155] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.673952] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.932652] env[65553]: INFO networking_nsxv3.common.synchronization [req-4e84fcbc-f059-4cff-bb89-6936d7604cbb req-6515c04f-bd84-4c99-8fec-483cfcb77f66 tempest-ServersAdminNegativeTestJSON-2073833851 tempest-ServersAdminNegativeTestJSON-2073833851-project-member] Enqueued Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 687.934836] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 687.935457] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.935779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.935969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.936343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.936624] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.938069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.938069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.938069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.938069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.938069] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.163292] env[65553]: INFO networking_nsxv3.common.synchronization [None req-74d4fca3-cf1b-4fec-bf9c-36b485785ace None None] Enqueued Resource ID: f5c500a6-9635-4c2e-a60c-014c5c2b1a7b with Priority: HIGHEST for action port [ 688.163968] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5c500a6-9635-4c2e-a60c-014c5c2b1a7b with Priority: HIGHEST for action port [ 688.164355] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5c500a6-9635-4c2e-a60c-014c5c2b1a7b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.164443] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5c500a6-9635-4c2e-a60c-014c5c2b1a7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.164678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5c500a6-9635-4c2e-a60c-014c5c2b1a7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.164875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5c500a6-9635-4c2e-a60c-014c5c2b1a7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.164957] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5c500a6-9635-4c2e-a60c-014c5c2b1a7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.177554] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.177711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.177807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.178036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.178127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.178224] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be updated. [ 688.208274] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.208447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.208537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.208763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.208907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.220506] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 2s [ 688.441123] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.441316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.442035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.442035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.442035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.442035] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.442035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.442243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.442243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.442289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.442374] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 already deleted. [ 688.442449] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.669058] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5c500a6-9635-4c2e-a60c-014c5c2b1a7b [ 688.669344] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.669495] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.669563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.669806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.671997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.671997] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5c500a6-9635-4c2e-a60c-014c5c2b1a7b already deleted. [ 688.671997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5c500a6-9635-4c2e-a60c-014c5c2b1a7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.364046] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.364046] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.364046] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.364046] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.364046] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.364046] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.364046] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.365069] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.365359] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.365714] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.365934] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.367089] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.367089] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.367089] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.367089] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.367089] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.391816] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.391816] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 689.391816] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.391816] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.392284] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-fef6d1bb-8069-4f23-9a13-42a36dd6618d taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.392541] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-fef6d1bb-8069-4f23-9a13-42a36dd6618d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.392935] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-fef6d1bb-8069-4f23-9a13-42a36dd6618d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.393332] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-fef6d1bb-8069-4f23-9a13-42a36dd6618d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.393538] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fef6d1bb-8069-4f23-9a13-42a36dd6618d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.563035] env[65553]: INFO networking_nsxv3.common.synchronization [None req-9c1fa74c-01b2-4427-bdb3-c433b777f3d1 None None] Enqueued Resource ID: ecd55428-c209-41e0-9664-70f89c855e84 with Priority: HIGHEST for action port [ 689.563818] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd55428-c209-41e0-9664-70f89c855e84 with Priority: HIGHEST for action port [ 689.564185] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecd55428-c209-41e0-9664-70f89c855e84 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.564325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecd55428-c209-41e0-9664-70f89c855e84" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.564401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecd55428-c209-41e0-9664-70f89c855e84" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.564734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecd55428-c209-41e0-9664-70f89c855e84" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.564851] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecd55428-c209-41e0-9664-70f89c855e84',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.898762] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.899080] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.899156] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.899529] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.899584] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.899696] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port fef6d1bb-8069-4f23-9a13-42a36dd6618d not found, creating... [ 689.900055] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.900200] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.900341] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.900622] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.900789] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.901105] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.901272] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.901384] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.901589] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.902707] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.903070] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: fef6d1bb-8069-4f23-9a13-42a36dd6618d is going to be created. [ 689.926066] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.926481] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.926481] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.926706] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.926929] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.927159] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-fef6d1bb-8069-4f23-9a13-42a36dd6618d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.069885] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecd55428-c209-41e0-9664-70f89c855e84 [ 690.069885] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.069885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.069885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.069885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.069885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.069885] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecd55428-c209-41e0-9664-70f89c855e84 already deleted. [ 690.069885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecd55428-c209-41e0-9664-70f89c855e84" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.231707] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 4s [ 690.481021] env[65553]: INFO networking_nsxv3.common.synchronization [None req-be83a5a4-34ef-40f9-bdbe-d93404583dcb None None] Enqueued Resource ID: a9ef1b73-80cb-4b23-b975-2af645062be4 with Priority: HIGHEST for action port [ 690.481021] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ef1b73-80cb-4b23-b975-2af645062be4 with Priority: HIGHEST for action port [ 690.481666] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9ef1b73-80cb-4b23-b975-2af645062be4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.481666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9ef1b73-80cb-4b23-b975-2af645062be4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.484171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9ef1b73-80cb-4b23-b975-2af645062be4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.484171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9ef1b73-80cb-4b23-b975-2af645062be4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.484171] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9ef1b73-80cb-4b23-b975-2af645062be4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.717314] env[65553]: INFO networking_nsxv3.common.synchronization [req-4e84fcbc-f059-4cff-bb89-6936d7604cbb req-95c38776-544f-4bfe-a337-75a8de9e0f3b service nova] Enqueued Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_rules [ 690.717314] env[65553]: INFO networking_nsxv3.common.synchronization [req-4e84fcbc-f059-4cff-bb89-6936d7604cbb req-95c38776-544f-4bfe-a337-75a8de9e0f3b service nova] Enqueued Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 690.717314] env[65553]: INFO networking_nsxv3.common.synchronization [req-4e84fcbc-f059-4cff-bb89-6936d7604cbb req-95c38776-544f-4bfe-a337-75a8de9e0f3b service nova] Enqueued Resource ID: fef6d1bb-8069-4f23-9a13-42a36dd6618d with Priority: HIGHEST for action port [ 690.719147] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_rules [ 690.719147] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 690.719147] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef6d1bb-8069-4f23-9a13-42a36dd6618d with Priority: HIGHEST for action port [ 690.720669] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.720669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.720669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.720854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.720978] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.721975] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.722348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.722453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.722680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.722882] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.723023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.723108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.723286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.723397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.723520] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.725247] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-fef6d1bb-8069-4f23-9a13-42a36dd6618d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.725247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fef6d1bb-8069-4f23-9a13-42a36dd6618d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.725247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fef6d1bb-8069-4f23-9a13-42a36dd6618d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.725247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fef6d1bb-8069-4f23-9a13-42a36dd6618d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.725247] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fef6d1bb-8069-4f23-9a13-42a36dd6618d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.847492] env[65553]: INFO networking_nsxv3.common.synchronization [req-8e98e7e5-f3eb-4d56-b23a-9e765217af8f req-f7123da5-2063-4b91-86ca-91a78aa62cd7 tempest-ServerTagsTestJSON-23482399 tempest-ServerTagsTestJSON-23482399-project-member] Enqueued Resource ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 with Priority: HIGHEST for action security_group_members [ 690.848144] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 with Priority: HIGHEST for action security_group_members [ 690.848474] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e7647e8-bc93-4ca1-af77-c7da9c980011 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.848614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.848681] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.848894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.849195] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.849315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.849381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.849616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.849716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.849814] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e7647e8-bc93-4ca1-af77-c7da9c980011',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.986071] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9ef1b73-80cb-4b23-b975-2af645062be4 [ 690.986482] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.986652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.986726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.987637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.987778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.987855] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9ef1b73-80cb-4b23-b975-2af645062be4 already deleted. [ 690.987936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9ef1b73-80cb-4b23-b975-2af645062be4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.230632] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.230769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.231128] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.234382] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fef6d1bb-8069-4f23-9a13-42a36dd6618d with status ACTIVE [ 691.234382] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.234382] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.234382] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.234382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.234382] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fef6d1bb-8069-4f23-9a13-42a36dd6618d is going to be updated. [ 691.264287] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.267451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.267451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.267451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.267451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.267451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fef6d1bb-8069-4f23-9a13-42a36dd6618d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.354338] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.354338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.354338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.354338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.354338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.354338] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.354338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.354338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.354338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.354338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.354338] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 is going to be updated. [ 691.375678] env[65553]: INFO networking_nsxv3.common.synchronization [None req-fd8d9609-d2d7-4889-9080-d4487ca68d6f None None] Enqueued Resource ID: 3fbfa237-16c5-4c82-a17e-2d44b3c9f93a with Priority: HIGHEST for action port [ 691.377699] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fbfa237-16c5-4c82-a17e-2d44b3c9f93a with Priority: HIGHEST for action port [ 691.379800] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fbfa237-16c5-4c82-a17e-2d44b3c9f93a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.380076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fbfa237-16c5-4c82-a17e-2d44b3c9f93a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.380588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fbfa237-16c5-4c82-a17e-2d44b3c9f93a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.380588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fbfa237-16c5-4c82-a17e-2d44b3c9f93a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.380588] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fbfa237-16c5-4c82-a17e-2d44b3c9f93a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.396388] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.396703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.396921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.398045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.398045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.417686] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 in Status: IN_PROGRESS for 2s [ 691.733059] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.886531] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fbfa237-16c5-4c82-a17e-2d44b3c9f93a [ 691.886987] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.887058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.887122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.887347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.887435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.888855] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fbfa237-16c5-4c82-a17e-2d44b3c9f93a already deleted. [ 691.888855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fbfa237-16c5-4c82-a17e-2d44b3c9f93a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.236574] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.237228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.237369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.237561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.237659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.237751] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 is going to be created. [ 692.249572] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 692.249924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.250067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.250348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.250565] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.250741] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.250814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.251122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.251155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.251304] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.259403] env[65553]: INFO networking_nsxv3.common.synchronization [req-6eb28504-fadb-4689-bdfc-5273e0018e48 req-d244e636-c011-4e68-923b-48d83522d5bd tempest-MultipleCreateTestJSON-1937935220 tempest-MultipleCreateTestJSON-1937935220-project-member] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 692.261582] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 692.262032] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.262319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.262381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.262733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.262840] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.263032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.263032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.263174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.263267] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.263372] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.270037] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.270300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.270300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.270821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.270821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.288027] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: UNINITIALIZED for 2s [ 692.711494] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-128 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.711703] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.711797] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.712148] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.713229] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.714025] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.714025] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.714295] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.714444] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.714700] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.714812] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.714935] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.715078] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.715194] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.715294] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.715427] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.743240] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.743617] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 692.743617] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.743799] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.744151] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-ea742e2d-4f98-4033-9608-71d621b31ebb taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.744350] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-ea742e2d-4f98-4033-9608-71d621b31ebb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.744475] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-ea742e2d-4f98-4033-9608-71d621b31ebb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.744923] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-ea742e2d-4f98-4033-9608-71d621b31ebb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.745283] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea742e2d-4f98-4033-9608-71d621b31ebb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.752260] env[65553]: INFO networking_nsxv3.common.synchronization [None req-af17812a-7962-4a5a-8968-25cc891d491c tempest-ServersTestFqdnHostnames-1268563277 tempest-ServersTestFqdnHostnames-1268563277-project-member] Enqueued Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_rules [ 692.752852] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_rules [ 692.753347] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.753347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.753492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.753646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.753729] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.757499] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.768673] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.768804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.768917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.769095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.769185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.769372] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.769461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.769518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.769676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.769747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.769835] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 already deleted. [ 692.769938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.893179] env[65553]: INFO networking_nsxv3.common.synchronization [None req-fc8d0541-0f7e-4fcb-a6b8-e41f19110425 tempest-ServersTestFqdnHostnames-1268563277 tempest-ServersTestFqdnHostnames-1268563277-project-member] Enqueued Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_rules [ 692.893478] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_rules [ 692.893785] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.893888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.248433] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.248676] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.248785] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.249141] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.249304] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.249479] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port ea742e2d-4f98-4033-9608-71d621b31ebb not found, creating... [ 693.249740] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.249889] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.249996] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.250251] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.250387] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.250681] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.250847] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.251453] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.251722] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.251903] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.252085] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: ea742e2d-4f98-4033-9608-71d621b31ebb is going to be created. [ 693.259294] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.283709] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.286404] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.286672] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.286945] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.287235] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.287472] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-ea742e2d-4f98-4033-9608-71d621b31ebb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.289658] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.289782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.289845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.290034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.290120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.290209] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd already deleted. [ 693.290288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.290426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.290585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.290672] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.428262] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 in Status: SUCCESS [ 693.428431] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e7647e8-bc93-4ca1-af77-c7da9c980011 deletion is rescheduled due to dependency. [ 693.428495] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e7647e8-bc93-4ca1-af77-c7da9c980011" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.707974] env[65553]: INFO networking_nsxv3.common.synchronization [None req-96003ed1-c493-4f2e-9212-190b71aae783 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_rules [ 693.709038] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_rules [ 693.709038] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28be331c-2041-41ac-9f2a-5746e8762908 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.709232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.709232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.709383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.709470] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28be331c-2041-41ac-9f2a-5746e8762908',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.763209] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.763584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.763584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.763661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.763727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.763829] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be updated. [ 693.805052] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.805282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.805360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.805684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.805881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.813375] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.813560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.813647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.813905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.814015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.814119] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd already deleted. [ 693.814201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.823026] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 2s [ 693.879070] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d34e9356-e707-4042-afdc-69437ae57d3b tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_rules [ 693.879789] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_rules [ 693.880127] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28be331c-2041-41ac-9f2a-5746e8762908 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.880223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.021391] env[65553]: INFO networking_nsxv3.common.synchronization [req-6eb28504-fadb-4689-bdfc-5273e0018e48 req-14cd1a1a-eb9f-4bd3-a314-45f59b1f03f8 service nova] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_rules [ 694.021391] env[65553]: INFO networking_nsxv3.common.synchronization [req-6eb28504-fadb-4689-bdfc-5273e0018e48 req-14cd1a1a-eb9f-4bd3-a314-45f59b1f03f8 service nova] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 694.021391] env[65553]: INFO networking_nsxv3.common.synchronization [req-6eb28504-fadb-4689-bdfc-5273e0018e48 req-14cd1a1a-eb9f-4bd3-a314-45f59b1f03f8 service nova] Enqueued Resource ID: ea742e2d-4f98-4033-9608-71d621b31ebb with Priority: HIGHEST for action port [ 694.022179] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_rules [ 694.022342] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 694.022443] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea742e2d-4f98-4033-9608-71d621b31ebb with Priority: HIGHEST for action port [ 694.022737] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.022861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.022955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.023242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.023406] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.024717] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.024876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.024985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.025492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.025580] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.025662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.025736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.025904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.025994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.026117] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.027095] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea742e2d-4f98-4033-9608-71d621b31ebb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.027252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea742e2d-4f98-4033-9608-71d621b31ebb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.027333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea742e2d-4f98-4033-9608-71d621b31ebb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.027569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea742e2d-4f98-4033-9608-71d621b31ebb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.027701] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea742e2d-4f98-4033-9608-71d621b31ebb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.180912] env[65553]: INFO networking_nsxv3.common.synchronization [req-70ed8082-8f90-4611-8d92-0c4acc12d6d2 req-7fa47b97-b58e-46c5-9a6a-b131ed34b69d tempest-SecurityGroupRulesTestJSON-49115618 tempest-SecurityGroupRulesTestJSON-49115618-project-member] Enqueued Resource ID: 29d0d1f7-bd4c-427f-b338-e64a5d9446f4 with Priority: HIGHEST for action security_group_rules [ 694.183033] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d0d1f7-bd4c-427f-b338-e64a5d9446f4 with Priority: HIGHEST for action security_group_rules [ 694.183033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.183033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.183033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.183033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.183033] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d0d1f7-bd4c-427f-b338-e64a5d9446f4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.236599] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.236781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.236856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.239900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.239900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.239900] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28be331c-2041-41ac-9f2a-5746e8762908 already deleted. [ 694.239900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.239900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.239900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.239900] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28be331c-2041-41ac-9f2a-5746e8762908',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.302626] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: SUCCESS [ 694.302851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.303040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.303275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.303493] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.303617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.303684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.303869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.303926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.304180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.304285] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.530106] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.531262] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.531372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.534961] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea742e2d-4f98-4033-9608-71d621b31ebb with status ACTIVE [ 694.534961] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.534961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.534961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.535146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.535146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.535315] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.535409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.535465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.535622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.535692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.535940] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.536056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.536114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.536252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.536322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.536403] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea742e2d-4f98-4033-9608-71d621b31ebb is going to be updated. [ 694.562452] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.562636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.562681] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.562894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.563057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.563217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea742e2d-4f98-4033-9608-71d621b31ebb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.714087] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.714260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.714321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.714501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.714686] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.714801] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d0d1f7-bd4c-427f-b338-e64a5d9446f4 already deleted. [ 694.714886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.764056] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.764337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.764337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.764486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.764640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.764737] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28be331c-2041-41ac-9f2a-5746e8762908 already deleted. [ 694.764823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.809492] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.809640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.809756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.809923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.810100] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.810193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.810254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.810402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.810488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.810574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.810718] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.810808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.810860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.810998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.811146] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.811234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.811295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.811426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.811502] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.811656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.811768] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.039382] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.156253] env[65553]: INFO networking_nsxv3.common.synchronization [req-6eb28504-fadb-4689-bdfc-5273e0018e48 req-bb7bd1d1-afc2-42dc-806a-b24a07269384 tempest-MultipleCreateTestJSON-1937935220 tempest-MultipleCreateTestJSON-1937935220-project-member] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 695.156480] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 695.156902] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.157036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.469251] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9: rpc.has_security_group_logging(os_id): False [ 695.495299] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.495553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.495553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.497143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.497143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.497143] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.497143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.497143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.497143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.497143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.497143] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.497143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.497143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.497143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.497802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.497802] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.497802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.497802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.498145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.498441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.498576] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 is going to be created. [ 695.543395] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.543526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.543601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.543945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.544168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.544332] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be created. [ 695.579331] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.579584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.579687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.580178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.580178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.584038] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.584251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.584251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.584682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.584734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.601545] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: UNINITIALIZED for 2s [ 695.602452] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: IN_PROGRESS for 2s [ 695.712706] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-128 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.712936] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.712980] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.713354] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.713747] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.713980] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.714167] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.714479] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.714746] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.715076] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.715431] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.715431] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.715431] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.715560] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.715607] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.715733] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.751266] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.751479] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.751593] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.751811] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.752180] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-39f0017a-b014-4ab7-917b-ca62faa72048 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.752658] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-39f0017a-b014-4ab7-917b-ca62faa72048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.752658] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-39f0017a-b014-4ab7-917b-ca62faa72048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.752939] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-39f0017a-b014-4ab7-917b-ca62faa72048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.753237] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39f0017a-b014-4ab7-917b-ca62faa72048',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.835744] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 695.836262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.836262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.836596] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.836724] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.836863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.837028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.837246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.837333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.837434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.837663] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.837911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.837911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.838048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.838110] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.838270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.838270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.838397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.838473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.838553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.838646] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.257504] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.257807] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.257942] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.258352] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.258984] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.258984] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 39f0017a-b014-4ab7-917b-ca62faa72048 not found, creating... [ 696.259237] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.259431] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.259952] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.259952] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.259952] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.260455] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.260455] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.260567] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.260886] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.261209] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.261339] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 39f0017a-b014-4ab7-917b-ca62faa72048 is going to be created. [ 696.293661] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.293906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.294037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.294330] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.294745] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.294826] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-39f0017a-b014-4ab7-917b-ca62faa72048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.341062] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebd49ee0-d72a-443f-a112-9fa0a970c7be: rpc.has_security_group_logging(os_id): False [ 696.366579] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.367012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.367153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.367410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.367659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.368033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.368189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.368308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.368580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.368732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.369040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.369252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.369316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.369542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.369687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.369972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.370111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.370224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.370456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.370551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.370684] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be created. [ 696.392715] env[65553]: INFO networking_nsxv3.common.synchronization [req-2a9e06e1-53a1-473d-a1bd-4ae34c7177d0 req-b8276e0b-f624-4ff3-8af2-72299d9b8d5f tempest-SecurityGroupRulesTestJSON-49115618 tempest-SecurityGroupRulesTestJSON-49115618-project-member] Enqueued Resource ID: 29d0d1f7-bd4c-427f-b338-e64a5d9446f4 with Priority: HIGHEST for action security_group_rules [ 696.393339] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d0d1f7-bd4c-427f-b338-e64a5d9446f4 with Priority: HIGHEST for action security_group_rules [ 696.393650] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.393770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.393860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.394124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.394214] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d0d1f7-bd4c-427f-b338-e64a5d9446f4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.485392] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.485588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.485737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.486108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.486442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.500415] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 2s [ 696.917470] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.918920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.918920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.918920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.918920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.918920] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d0d1f7-bd4c-427f-b338-e64a5d9446f4 already deleted. [ 696.918920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.481814] env[65553]: INFO networking_nsxv3.common.synchronization [req-6eb28504-fadb-4689-bdfc-5273e0018e48 req-cf7e86ad-813b-4da3-95f6-5915c4509c06 service nova] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_rules [ 697.482031] env[65553]: INFO networking_nsxv3.common.synchronization [req-6eb28504-fadb-4689-bdfc-5273e0018e48 req-cf7e86ad-813b-4da3-95f6-5915c4509c06 service nova] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 697.482143] env[65553]: INFO networking_nsxv3.common.synchronization [req-6eb28504-fadb-4689-bdfc-5273e0018e48 req-cf7e86ad-813b-4da3-95f6-5915c4509c06 service nova] Enqueued Resource ID: 39f0017a-b014-4ab7-917b-ca62faa72048 with Priority: HIGHEST for action port [ 697.482674] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_rules [ 697.483218] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 697.483218] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39f0017a-b014-4ab7-917b-ca62faa72048 with Priority: HIGHEST for action port [ 697.485779] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.485779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.485779] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.485779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.485779] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-39f0017a-b014-4ab7-917b-ca62faa72048 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.485779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39f0017a-b014-4ab7-917b-ca62faa72048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.485779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39f0017a-b014-4ab7-917b-ca62faa72048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.485779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39f0017a-b014-4ab7-917b-ca62faa72048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.485779] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39f0017a-b014-4ab7-917b-ca62faa72048',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.614686] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 697.614874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.615481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.615735] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.615914] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.616050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.616116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.616274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.616388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.616491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.616594] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.618277] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: SUCCESS [ 697.618958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.618958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.618958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.618958] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.619154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.619154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.619228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.619673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.619673] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.623035] env[65553]: INFO networking_nsxv3.common.synchronization [req-5b331ff8-083c-4995-960b-a83d078a5375 req-f59a1226-3a30-428e-825b-90ced1b94b6d tempest-ServersTestBootFromVolume-1810122885 tempest-ServersTestBootFromVolume-1810122885-project-member] Enqueued Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_members [ 697.623835] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_members [ 697.623925] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a425597-2f3a-4763-9abe-b15432eceec7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.624067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.624143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.624322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.624478] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.624845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.624845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.624845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.624999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.624999] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.990703] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39f0017a-b014-4ab7-917b-ca62faa72048 with status ACTIVE [ 697.992858] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.992858] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.992858] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.992858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.993962] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39f0017a-b014-4ab7-917b-ca62faa72048 is going to be updated. [ 698.018790] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.018932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.018999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.019272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.019422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.019576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39f0017a-b014-4ab7-917b-ca62faa72048" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.098568] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.098707] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-200" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.099064] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-200" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.099690] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-200" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.100596] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.100596] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.100596] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.103232] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.103232] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.103232] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.103232] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.103232] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.103232] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.103232] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.103232] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.103232] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.122212] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.122212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.122212] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.127846] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.128096] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.128204] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.128349] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-200" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.128684] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-fe6250fb-76b2-48b7-b29b-7245cf43f898 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.128908] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-fe6250fb-76b2-48b7-b29b-7245cf43f898" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.129165] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-fe6250fb-76b2-48b7-b29b-7245cf43f898" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.129393] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-fe6250fb-76b2-48b7-b29b-7245cf43f898" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.129515] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe6250fb-76b2-48b7-b29b-7245cf43f898',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.133883] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.133883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.133883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.133883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.133883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.133883] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.133883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.133883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.133883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.133883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.133883] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a425597-2f3a-4763-9abe-b15432eceec7 already deleted. [ 698.133883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.514762] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 698.515208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.515301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.515465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.515550] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.625091] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.635418] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.635627] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.635783] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.636057] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.636289] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.636736] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port fe6250fb-76b2-48b7-b29b-7245cf43f898 not found, creating... [ 698.636736] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.636876] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.636941] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.637184] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.637316] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.637593] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.637740] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.637888] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.638195] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.638331] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.638466] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: fe6250fb-76b2-48b7-b29b-7245cf43f898 is going to be created. [ 698.667307] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.667516] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.667649] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.667901] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.668359] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.668598] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-fe6250fb-76b2-48b7-b29b-7245cf43f898" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.017933] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.018266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.018266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.018558] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.018786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.018923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.019062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.019283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.019351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.019461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.019575] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.128254] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.128433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.128521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.128945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.129083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.129236] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 699.169128] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.169376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.169376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.169596] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.169700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.181557] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 699.420128] env[65553]: INFO networking_nsxv3.common.synchronization [req-5b331ff8-083c-4995-960b-a83d078a5375 req-497ee4ed-49dd-41ed-8c2f-b8e831a98847 service nova] Enqueued Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_rules [ 699.420299] env[65553]: INFO networking_nsxv3.common.synchronization [req-5b331ff8-083c-4995-960b-a83d078a5375 req-497ee4ed-49dd-41ed-8c2f-b8e831a98847 service nova] Enqueued Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_members [ 699.420427] env[65553]: INFO networking_nsxv3.common.synchronization [req-5b331ff8-083c-4995-960b-a83d078a5375 req-497ee4ed-49dd-41ed-8c2f-b8e831a98847 service nova] Enqueued Resource ID: fe6250fb-76b2-48b7-b29b-7245cf43f898 with Priority: HIGHEST for action port [ 699.421530] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_rules [ 699.421530] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_members [ 699.421530] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe6250fb-76b2-48b7-b29b-7245cf43f898 with Priority: HIGHEST for action port [ 699.421530] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a425597-2f3a-4763-9abe-b15432eceec7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.421792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.421792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.423022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.423022] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.423022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a425597-2f3a-4763-9abe-b15432eceec7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.423277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.423277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.423332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.423660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.423660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.423660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.423778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.424138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.424138] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.425538] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe6250fb-76b2-48b7-b29b-7245cf43f898 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.425538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe6250fb-76b2-48b7-b29b-7245cf43f898" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.425538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe6250fb-76b2-48b7-b29b-7245cf43f898" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.425753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe6250fb-76b2-48b7-b29b-7245cf43f898" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.425753] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe6250fb-76b2-48b7-b29b-7245cf43f898',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.522577] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.522794] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.522876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.523572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.524071] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.526766] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.526766] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.526766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.527341] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.527341] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.870151] env[65553]: INFO networking_nsxv3.common.synchronization [req-2b8bf063-af4f-4a33-8818-4593cdce12e5 req-5e24fd32-24ed-40f9-a400-4035040927c5 tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 699.870723] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 699.871295] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.871295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.871295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.871508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.871634] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.871740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.871808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.871959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.872071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.872196] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.927360] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a425597-2f3a-4763-9abe-b15432eceec7 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.930061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.930061] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.930061] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe6250fb-76b2-48b7-b29b-7245cf43f898 with status ACTIVE [ 699.930061] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.930061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.930061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.930061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.930061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.930746] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.931720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.931720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.934830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.934830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.934830] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.934830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.934830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.934830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.934830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.934830] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe6250fb-76b2-48b7-b29b-7245cf43f898 is going to be updated. [ 699.962113] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.963076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.963076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.963076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.963076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.963284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe6250fb-76b2-48b7-b29b-7245cf43f898" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.030150] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebd49ee0-d72a-443f-a112-9fa0a970c7be: rpc.has_security_group_logging(os_id): False [ 700.053812] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.054108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.055938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.056213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.056334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.056566] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.056683] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.056750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.056914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.056998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.057557] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.057557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.057557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.057557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.057723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.057796] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.058251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.058251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.058251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.058401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.058401] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be updated. [ 700.166865] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.168051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.168051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.168051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.168051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.185583] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 2s [ 700.318458] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.318683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.318814] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.319475] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.319863] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.320065] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.320202] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.320478] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.322154] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.323294] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.323459] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.323644] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.323804] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.323902] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.324067] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.324247] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.348197] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.348474] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 700.348689] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.348918] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.349431] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-8b6b80b6-f2b4-42fd-96ca-8243ca6bd691 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.349626] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-8b6b80b6-f2b4-42fd-96ca-8243ca6bd691" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.349771] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-8b6b80b6-f2b4-42fd-96ca-8243ca6bd691" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.352165] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-8b6b80b6-f2b4-42fd-96ca-8243ca6bd691" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.352165] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b6b80b6-f2b4-42fd-96ca-8243ca6bd691',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.377433] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.377838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.377999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.378610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.378610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.378985] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.379074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.379169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.379415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.379536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.379669] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 already deleted. [ 700.379796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.435843] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.854805] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.855161] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.855314] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.856075] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.856075] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.856075] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 8b6b80b6-f2b4-42fd-96ca-8243ca6bd691 not found, creating... [ 700.856371] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.856482] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.856625] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.857333] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.857333] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.858473] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.858946] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.858946] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.859996] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.860097] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.860797] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 8b6b80b6-f2b4-42fd-96ca-8243ca6bd691 is going to be created. [ 700.905094] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.905094] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.905324] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.905552] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.905798] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.906051] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-8b6b80b6-f2b4-42fd-96ca-8243ca6bd691" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.939473] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.939743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.939743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.940026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.940151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.940256] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a425597-2f3a-4763-9abe-b15432eceec7 is going to be created. [ 700.987528] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.988097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.988363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.989100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.989649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.005226] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a425597-2f3a-4763-9abe-b15432eceec7 in Status: UNINITIALIZED for 2s [ 701.194042] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 701.194504] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.194504] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.194872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.195093] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.195237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.195310] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.195488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.195584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.195704] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.660800] env[65553]: INFO networking_nsxv3.common.synchronization [req-2b8bf063-af4f-4a33-8818-4593cdce12e5 req-42c3fdc3-c678-4da2-968e-4908ce731371 service nova] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_rules [ 701.660800] env[65553]: INFO networking_nsxv3.common.synchronization [req-2b8bf063-af4f-4a33-8818-4593cdce12e5 req-42c3fdc3-c678-4da2-968e-4908ce731371 service nova] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 701.660800] env[65553]: INFO networking_nsxv3.common.synchronization [req-2b8bf063-af4f-4a33-8818-4593cdce12e5 req-42c3fdc3-c678-4da2-968e-4908ce731371 service nova] Enqueued Resource ID: 8b6b80b6-f2b4-42fd-96ca-8243ca6bd691 with Priority: HIGHEST for action port [ 701.660800] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_rules [ 701.660800] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 701.661101] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b6b80b6-f2b4-42fd-96ca-8243ca6bd691 with Priority: HIGHEST for action port [ 701.662019] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.662336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.662625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.662939] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.663183] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.665415] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.665668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.666153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.667137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.667426] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.667676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.667935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.669282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.669282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.669282] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.670604] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b6b80b6-f2b4-42fd-96ca-8243ca6bd691 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.670976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b6b80b6-f2b4-42fd-96ca-8243ca6bd691" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.674315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b6b80b6-f2b4-42fd-96ca-8243ca6bd691" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.674315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b6b80b6-f2b4-42fd-96ca-8243ca6bd691" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.674315] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b6b80b6-f2b4-42fd-96ca-8243ca6bd691',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.700404] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.715022] env[65553]: INFO networking_nsxv3.common.synchronization [req-64cfe489-450a-4405-9e4b-f15bbe98545e req-f9009fdd-4b47-4fbb-8c04-c5e2eda28475 tempest-ListServersNegativeTestJSON-1035197214 tempest-ListServersNegativeTestJSON-1035197214-project-member] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 701.715022] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 701.715660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.716081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.718286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.718286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.718286] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.718286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.718286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.718286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.718286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.718286] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.856411] env[65553]: INFO networking_nsxv3.common.synchronization [req-ba2ac929-456f-4549-8982-8c584fd49cee req-ac1112c0-3b95-480c-9a2f-4655de4ac4aa tempest-SecurityGroupRulesTestJSON-49115618 tempest-SecurityGroupRulesTestJSON-49115618-project-member] Enqueued Resource ID: 29d0d1f7-bd4c-427f-b338-e64a5d9446f4 with Priority: HIGHEST for action security_group_rules [ 701.857065] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d0d1f7-bd4c-427f-b338-e64a5d9446f4 with Priority: HIGHEST for action security_group_rules [ 701.857412] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.857520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.857609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.857815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.857907] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d0d1f7-bd4c-427f-b338-e64a5d9446f4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.166631] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.166828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.171946] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.178723] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b6b80b6-f2b4-42fd-96ca-8243ca6bd691 with status ACTIVE [ 702.178723] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.178723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.178723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.178937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.178937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.179164] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.179277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.179362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.179555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.179796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.179859] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.179950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.179999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.180222] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.180311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.180395] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b6b80b6-f2b4-42fd-96ca-8243ca6bd691 is going to be updated. [ 702.202778] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 702.203175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.203343] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.204419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.205476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.205756] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.207896] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.208109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.208180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.208381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.208527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.208716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b6b80b6-f2b4-42fd-96ca-8243ca6bd691" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.221126] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.384825] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.385054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.385054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.385301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.385383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.386282] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d0d1f7-bd4c-427f-b338-e64a5d9446f4 already deleted. [ 702.386282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d0d1f7-bd4c-427f-b338-e64a5d9446f4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.541601] env[65553]: INFO networking_nsxv3.common.synchronization [req-f241f684-480f-445e-8a1a-9ce08475dc5d req-d066a594-5671-41a9-9f49-a250c0e74cd0 tempest-ServerAddressesTestJSON-1715630683 tempest-ServerAddressesTestJSON-1715630683-project-member] Enqueued Resource ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 with Priority: HIGHEST for action security_group_members [ 702.542235] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 with Priority: HIGHEST for action security_group_members [ 702.543058] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.543058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.543058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.543238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.543314] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.543415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.543472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.543629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.543710] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.543802] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7d6f932-0d6e-4b85-a4f1-f60e841549d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.678509] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.711145] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.711145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.711145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.711145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.711145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.711145] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 702.711145] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.711145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.724284] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.751795] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.752053] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.755276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.755276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.755276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.766130] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 703.013644] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-619 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.013825] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-619" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.013825] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-619" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.015391] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-619" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.015812] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.015980] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.016124] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.016356] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.017621] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.017621] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.017621] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.017621] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.017621] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.017621] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.017621] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.017621] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.019098] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a425597-2f3a-4763-9abe-b15432eceec7 in Status: SUCCESS [ 703.019299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.019811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.020083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.020209] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.020349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.020403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.020786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.020786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.020786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.020786] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.040681] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.040805] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.040921] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.041769] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-619" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.042258] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-d54eb920-3a81-48ca-83bf-2c47bb47ae96 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.042365] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-d54eb920-3a81-48ca-83bf-2c47bb47ae96" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.042476] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-d54eb920-3a81-48ca-83bf-2c47bb47ae96" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.042864] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-d54eb920-3a81-48ca-83bf-2c47bb47ae96" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.042996] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d54eb920-3a81-48ca-83bf-2c47bb47ae96',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.046983] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.046983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.046983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.047184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.047184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.047372] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.047451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.047497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.047733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.047733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.047810] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 already deleted. [ 703.048055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.181514] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.181826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.181920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.182214] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.182395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.182543] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be created. [ 703.213728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.214202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.214267] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.214586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.215062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.228194] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: UNINITIALIZED for 2s [ 703.229737] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.229910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.229975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.230217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.230311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.230406] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be updated. [ 703.274358] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.274358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.274358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.274358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.274358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.288082] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 2s [ 703.524794] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.545859] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.546163] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.546315] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.546720] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.547015] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.547111] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port d54eb920-3a81-48ca-83bf-2c47bb47ae96 not found, creating... [ 703.547310] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.547458] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.547564] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.547783] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.547945] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.548200] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.548454] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.548454] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.548645] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.548771] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.548936] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: d54eb920-3a81-48ca-83bf-2c47bb47ae96 is going to be created. [ 703.571587] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.571804] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.571919] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.572256] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.572536] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.572759] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-d54eb920-3a81-48ca-83bf-2c47bb47ae96" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.031212] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a425597-2f3a-4763-9abe-b15432eceec7: rpc.has_security_group_logging(os_id): False [ 704.048827] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.049101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.049184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.049479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.049617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.052158] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.052158] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.052158] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.052158] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.052158] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.052158] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a425597-2f3a-4763-9abe-b15432eceec7 is going to be created. [ 704.150572] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.150740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.150859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.151129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.151345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.168080] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a425597-2f3a-4763-9abe-b15432eceec7 in Status: IN_PROGRESS for 2s [ 704.421231] env[65553]: INFO networking_nsxv3.common.synchronization [req-f241f684-480f-445e-8a1a-9ce08475dc5d req-b19e2b5d-d7ea-4f24-82f7-fa3800a13ca1 service nova] Enqueued Resource ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 with Priority: HIGHEST for action security_group_rules [ 704.421231] env[65553]: INFO networking_nsxv3.common.synchronization [req-f241f684-480f-445e-8a1a-9ce08475dc5d req-b19e2b5d-d7ea-4f24-82f7-fa3800a13ca1 service nova] Enqueued Resource ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 with Priority: HIGHEST for action security_group_members [ 704.421606] env[65553]: INFO networking_nsxv3.common.synchronization [req-f241f684-480f-445e-8a1a-9ce08475dc5d req-b19e2b5d-d7ea-4f24-82f7-fa3800a13ca1 service nova] Enqueued Resource ID: d54eb920-3a81-48ca-83bf-2c47bb47ae96 with Priority: HIGHEST for action port [ 704.421888] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 with Priority: HIGHEST for action security_group_rules [ 704.422713] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 with Priority: HIGHEST for action security_group_members [ 704.426195] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d54eb920-3a81-48ca-83bf-2c47bb47ae96 with Priority: HIGHEST for action port [ 704.426195] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7d6f932-0d6e-4b85-a4f1-f60e841549d8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.426195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.426195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.426195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.426195] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7d6f932-0d6e-4b85-a4f1-f60e841549d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.427641] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.427828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.427874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.428226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.428226] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.428343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.428405] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.428851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.428851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.428851] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7d6f932-0d6e-4b85-a4f1-f60e841549d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.429926] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d54eb920-3a81-48ca-83bf-2c47bb47ae96 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.430073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d54eb920-3a81-48ca-83bf-2c47bb47ae96" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.430145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d54eb920-3a81-48ca-83bf-2c47bb47ae96" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.430304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d54eb920-3a81-48ca-83bf-2c47bb47ae96" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.430398] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d54eb920-3a81-48ca-83bf-2c47bb47ae96',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.779017] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 704.779256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.779512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.779765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.779961] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.780094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.780167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.780337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.780419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.780511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.781016] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.781016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.781016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.781157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.781286] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.781383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.781674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.781674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.781674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.781759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.782335] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.932616] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7d6f932-0d6e-4b85-a4f1-f60e841549d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.933795] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.933924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.934256] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d54eb920-3a81-48ca-83bf-2c47bb47ae96 with status ACTIVE [ 704.934407] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.935116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.935116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.935116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.935116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.935116] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.935285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.935285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.935390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.935516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.935930] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.935930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.935930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.936142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.936830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.938339] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d54eb920-3a81-48ca-83bf-2c47bb47ae96 is going to be updated. [ 704.967453] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.967646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.967690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.968019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.968019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.968207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d54eb920-3a81-48ca-83bf-2c47bb47ae96" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.173882] env[65553]: INFO networking_nsxv3.common.synchronization [req-fc904dd3-9afd-415c-bb49-5f05d5e327f2 req-f6acf37d-9afe-4249-8403-be2dc9c2409c tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 705.174634] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 705.175021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.175272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.175272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.175600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.175799] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.175947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.176041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.176228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.176345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.176481] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.240472] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 705.240590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.241138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.241385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.241619] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.241715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.241799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.241988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.242086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.242172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.242262] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.286228] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f345373-ada8-463f-8791-7b6fdbbaba03: rpc.has_security_group_logging(os_id): False [ 705.299609] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 705.300401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.300705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.301235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.301527] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.301762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.301900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.302182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.302501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.302776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.302944] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.305026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.305331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.305478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.305772] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.305963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.306289] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.306509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.306821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.307097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.307281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.307828] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.308060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.308198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.311929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.311929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.311929] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.311929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.311929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.311929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.311929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.311929] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be created. [ 705.380531] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.380531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.380531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.380802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.380802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.394815] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 705.441661] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7d6f932-0d6e-4b85-a4f1-f60e841549d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.646942] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.647204] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.647327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.647622] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.647913] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.649571] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.649571] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.649571] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.649741] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.649931] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.650054] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.650160] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.650263] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.650371] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.650473] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.650623] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.669431] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.669593] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.669721] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.669887] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.670283] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-84b41a26-c4c9-48d8-a23f-1d49ebff3952 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.670461] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-84b41a26-c4c9-48d8-a23f-1d49ebff3952" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.670593] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-84b41a26-c4c9-48d8-a23f-1d49ebff3952" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.670944] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-84b41a26-c4c9-48d8-a23f-1d49ebff3952" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.671095] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84b41a26-c4c9-48d8-a23f-1d49ebff3952',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.678698] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.678891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.678891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.679104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.679384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.679618] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.679698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.679762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.679915] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.679995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.680092] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 already deleted. [ 705.680173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.745336] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.812244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.812416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.812486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.812820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.813020] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.813211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.813211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.813387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.813489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.813592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.813761] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.813879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.813945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.814127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.814447] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.814447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.814447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.814567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.814639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.814805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.814897] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.948595] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.948595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.948595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.948595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.948595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.948595] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 is going to be created. [ 705.981276] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.981276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.981276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.981276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.981276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.996970] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 in Status: UNINITIALIZED for 2s [ 706.173152] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.173735] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.173880] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.174172] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.174380] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.174567] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 84b41a26-c4c9-48d8-a23f-1d49ebff3952 not found, creating... [ 706.174934] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.175115] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.175241] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.175456] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.175589] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.175870] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.176035] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.176146] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.176348] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.176475] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.176605] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 84b41a26-c4c9-48d8-a23f-1d49ebff3952 is going to be created. [ 706.186373] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a425597-2f3a-4763-9abe-b15432eceec7 in Status: SUCCESS [ 706.186584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.197348] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.197348] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.197531] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.197852] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.197916] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.198327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-84b41a26-c4c9-48d8-a23f-1d49ebff3952" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.247554] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1246751-d3c4-4099-b16f-aa9fe0e1b1a6: rpc.has_security_group_logging(os_id): False [ 706.272234] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.272418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.272494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.272778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.272834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.273168] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.273283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.273571] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.273571] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.273654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.273742] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be created. [ 706.319795] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebd49ee0-d72a-443f-a112-9fa0a970c7be: rpc.has_security_group_logging(os_id): False [ 706.356574] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.356780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.356846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.357387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.357387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.357539] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.357539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.357685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.357740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.358756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.358756] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.358756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.358756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.358756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.358756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.358756] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.358756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.359216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.359216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.359216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.359216] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be updated. [ 706.523739] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.524144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.524144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.524220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.524368] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.551632] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 706.648463] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.648463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.648463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.648738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.648959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.682890] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 2s [ 706.963465] env[65553]: INFO networking_nsxv3.common.synchronization [req-fc904dd3-9afd-415c-bb49-5f05d5e327f2 req-b194eaf2-15ad-470f-98df-a592fba05547 service nova] Enqueued Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_rules [ 706.963465] env[65553]: INFO networking_nsxv3.common.synchronization [req-fc904dd3-9afd-415c-bb49-5f05d5e327f2 req-b194eaf2-15ad-470f-98df-a592fba05547 service nova] Enqueued Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 706.963465] env[65553]: INFO networking_nsxv3.common.synchronization [req-fc904dd3-9afd-415c-bb49-5f05d5e327f2 req-b194eaf2-15ad-470f-98df-a592fba05547 service nova] Enqueued Resource ID: 84b41a26-c4c9-48d8-a23f-1d49ebff3952 with Priority: HIGHEST for action port [ 706.963465] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_rules [ 706.963897] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 706.963897] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84b41a26-c4c9-48d8-a23f-1d49ebff3952 with Priority: HIGHEST for action port [ 706.963897] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.964126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.964126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.964346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.964417] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.966638] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.966638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.966638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.966638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.967526] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.967810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.967810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.967923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.967995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.972036] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.972036] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-84b41a26-c4c9-48d8-a23f-1d49ebff3952 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.972036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84b41a26-c4c9-48d8-a23f-1d49ebff3952" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.972036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84b41a26-c4c9-48d8-a23f-1d49ebff3952" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.972036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84b41a26-c4c9-48d8-a23f-1d49ebff3952" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.972036] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84b41a26-c4c9-48d8-a23f-1d49ebff3952',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.412378] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 707.412639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.412846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.413099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.413188] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.467137] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.467357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.470309] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.472591] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84b41a26-c4c9-48d8-a23f-1d49ebff3952 with status ACTIVE [ 707.472954] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.473130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.473199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.473624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.473684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.473871] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.473996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.474064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.474208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.474288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.474471] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.474558] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.474614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.474778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.474853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.474947] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84b41a26-c4c9-48d8-a23f-1d49ebff3952 is going to be updated. [ 707.503388] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.503538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.503592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.503808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.503938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.504112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84b41a26-c4c9-48d8-a23f-1d49ebff3952" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.897421] env[65553]: INFO networking_nsxv3.common.synchronization [req-ff309732-ff31-4e4d-b06f-c1bc8e66e43e req-1077a4c3-f906-43f2-a208-215bcd963c60 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 707.897961] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 707.898286] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.898404] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.898472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.898715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.898867] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.898993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.900746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.900746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.900746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.900746] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.918518] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.918697] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.918799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.919064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.919250] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.919347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.919412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.919568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.919655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.919745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.919887] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.972690] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.008784] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 in Status: SUCCESS [ 708.008989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.009173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.009410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.009605] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.009728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.009796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.009947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.010043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.010311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.010311] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7d6f932-0d6e-4b85-a4f1-f60e841549d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.327146] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-968 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.327822] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-968" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.328266] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-968" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.329228] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-968" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.331044] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.331044] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.331044] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.331044] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.331044] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.331044] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.331044] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.331044] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.331044] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.331044] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.331583] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.331583] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.365034] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.365034] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.365034] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.365034] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-968" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.365034] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-d21ff243-949d-403c-aad7-3c2cd67bf914 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.365034] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.365034] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.366125] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.366405] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d21ff243-949d-403c-aad7-3c2cd67bf914',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.403197] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.405236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.405236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.405236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.405236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.405236] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.405236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.405236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.405236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.405236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.405236] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 already deleted. [ 708.405236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.422557] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.422557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.422557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.422761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.422875] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.423015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.423120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.423312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.423423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.423538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.423733] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.423873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.423952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.424163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.424364] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.424492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.424581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.424923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.425046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.425167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.425295] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.477180] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.477365] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.477459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.477804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.477880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.478016] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 is going to be created. [ 708.508946] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.509178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.509327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.509480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.509649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.512434] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.512551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.512839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.513096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.513275] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.513389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.513452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.513651] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.513739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.513831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.513986] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.514126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.514190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.514337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.514477] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.514569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.514629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.514870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.514959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.515043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.515138] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7d6f932-0d6e-4b85-a4f1-f60e841549d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.523436] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: UNINITIALIZED for 2s [ 708.572258] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 708.572355] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.699238] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 708.699238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.869319] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.869850] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.870121] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.871042] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.871042] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.871042] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port d21ff243-949d-403c-aad7-3c2cd67bf914 not found, creating... [ 708.871190] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.872683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.872683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.872683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.872683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.872683] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.872907] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.872907] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.873119] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.873246] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.873379] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: d21ff243-949d-403c-aad7-3c2cd67bf914 is going to be created. [ 708.901959] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.902373] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.902373] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.902642] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.902854] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.903110] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.927806] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f345373-ada8-463f-8791-7b6fdbbaba03: rpc.has_security_group_logging(os_id): False [ 708.950177] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.950364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.950403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.950622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.950720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.950919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.951033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.951090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.951265] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.951332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.951607] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.951706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.951771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.951914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.951990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.952204] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.952299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.952656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.952656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.952656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.952840] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 709.018189] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7d6f932-0d6e-4b85-a4f1-f60e841549d8: rpc.has_security_group_logging(os_id): False [ 709.102299] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.102299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.102299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.102614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.102675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.102885] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.103016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.103097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.103306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.103390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.103639] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.103761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.103841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.103983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.104126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.104514] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.104670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.105066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.105066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.105196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.105254] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 is going to be created. [ 709.154260] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.154260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.154260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.154645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.154645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.171497] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 709.195033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.197020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.197020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.197020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.197020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.216926] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 in Status: IN_PROGRESS for 2s [ 709.669234] env[65553]: INFO networking_nsxv3.common.synchronization [req-ff309732-ff31-4e4d-b06f-c1bc8e66e43e req-c737abba-1447-4eb5-a0e8-f6974efdc533 service nova] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 709.669234] env[65553]: INFO networking_nsxv3.common.synchronization [req-ff309732-ff31-4e4d-b06f-c1bc8e66e43e req-c737abba-1447-4eb5-a0e8-f6974efdc533 service nova] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 709.669234] env[65553]: INFO networking_nsxv3.common.synchronization [req-ff309732-ff31-4e4d-b06f-c1bc8e66e43e req-c737abba-1447-4eb5-a0e8-f6974efdc533 service nova] Enqueued Resource ID: d21ff243-949d-403c-aad7-3c2cd67bf914 with Priority: HIGHEST for action port [ 709.669234] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 709.669234] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 709.669234] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21ff243-949d-403c-aad7-3c2cd67bf914 with Priority: HIGHEST for action port [ 709.669234] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.669734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.669907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.670255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.670425] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.671533] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.672557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.672740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.674028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.674356] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.676019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.676019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.676019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.676019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.676019] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.676451] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d21ff243-949d-403c-aad7-3c2cd67bf914 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.676683] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.676844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.677096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.677254] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d21ff243-949d-403c-aad7-3c2cd67bf914',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.180597] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.180913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.181334] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.183227] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d21ff243-949d-403c-aad7-3c2cd67bf914 with status ACTIVE [ 710.184327] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.184327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.184327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.184327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.184327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.184674] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.186174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.186376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.186782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.186979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.187331] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.187476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.187596] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.187885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.188068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.188204] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d21ff243-949d-403c-aad7-3c2cd67bf914 is going to be updated. [ 710.204520] env[65553]: INFO networking_nsxv3.common.synchronization [req-4b87f8ff-eb3d-4913-912d-b81da38db4ac req-ffd51544-37c7-45d7-9bae-f692c6e46ce2 tempest-ServerMetadataNegativeTestJSON-917010991 tempest-ServerMetadataNegativeTestJSON-917010991-project-member] Enqueued Resource ID: 30f1992f-8f85-4326-932f-434571d97d70 with Priority: HIGHEST for action security_group_members [ 710.205370] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f1992f-8f85-4326-932f-434571d97d70 with Priority: HIGHEST for action security_group_members [ 710.206894] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-30f1992f-8f85-4326-932f-434571d97d70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.207076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.207152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.207366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.208086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.208086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.208086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.208314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.208314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.209162] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30f1992f-8f85-4326-932f-434571d97d70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.221314] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.221314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.221314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.221314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.221314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.221314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.535179] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: SUCCESS [ 710.535439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.535652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.536931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.536931] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.536931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.536931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.536931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.536931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.536931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.536931] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.693329] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.715411] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.715603] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.715645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.715860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.715959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.716184] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.716744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.716744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.716744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.716744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.716744] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30f1992f-8f85-4326-932f-434571d97d70 is going to be updated. [ 710.746872] env[65553]: INFO networking_nsxv3.common.synchronization [req-ec323381-1f5a-4004-aa53-24ed06ea75a2 req-c4499af2-21a0-4ed3-ac4d-618599d37db0 tempest-FloatingIPsAssociationTestJSON-1444757961 tempest-FloatingIPsAssociationTestJSON-1444757961-project-member] Enqueued Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 710.747443] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 710.748075] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.748075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.748075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.748281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.748310] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.748416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.748477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.748620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.748705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.748798] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.750366] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.750472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.750535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.750691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.750820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.761846] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30f1992f-8f85-4326-932f-434571d97d70 in Status: IN_PROGRESS for 2s [ 711.043777] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.043777] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.043777] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.043777] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.043777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.044518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.044518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.044518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.044518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.044518] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.166016] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-512 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.166236] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-512" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.166349] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-512" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.166597] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-512" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.166841] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.166977] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.170256] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.171089] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.171089] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.171089] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.171089] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.171480] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.171593] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.171731] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.171837] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.171970] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.199446] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.199751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.199811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.200033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.200132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.200233] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be created. [ 711.216702] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 711.216963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.218893] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.219207] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.219407] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.219605] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-512" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.219944] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-3f6b4ed9-0012-498e-91bb-e0b39da30395 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.220171] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-3f6b4ed9-0012-498e-91bb-e0b39da30395" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.220306] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-3f6b4ed9-0012-498e-91bb-e0b39da30395" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.220682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-3f6b4ed9-0012-498e-91bb-e0b39da30395" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.220863] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f6b4ed9-0012-498e-91bb-e0b39da30395',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.233945] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 in Status: SUCCESS [ 711.234237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.246409] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.246409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.246409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.246409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.246828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.255266] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.258821] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: UNINITIALIZED for 2s [ 711.552108] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd69ea1e-9ecd-47c1-b65c-87418794c033: rpc.has_security_group_logging(os_id): False [ 711.585640] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.585809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.585894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.586197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.586387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.586629] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.586807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.590021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.590021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.590021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.590021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 is going to be created. [ 711.665934] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.666125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.666195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.666468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.666721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.683129] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: IN_PROGRESS for 2s [ 711.725406] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.725756] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.725956] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.726373] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.728274] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.728274] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 3f6b4ed9-0012-498e-91bb-e0b39da30395 not found, creating... [ 711.728274] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.728274] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.728274] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.730312] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.730312] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.730718] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.730893] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.731084] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.731794] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.731794] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.731794] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 3f6b4ed9-0012-498e-91bb-e0b39da30395 is going to be created. [ 711.757414] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.779178] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.779178] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.779178] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.779178] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.779178] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.779178] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-3f6b4ed9-0012-498e-91bb-e0b39da30395" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.260847] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.261276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.261276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.261445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.261547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.261651] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfefe395-d857-43f0-952f-7a8984da2f70 is going to be updated. [ 712.302882] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.303116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.303282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.303849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.303849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.320779] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: IN_PROGRESS for 2s [ 712.544988] env[65553]: INFO networking_nsxv3.common.synchronization [req-ec323381-1f5a-4004-aa53-24ed06ea75a2 req-7e47d3a9-e247-402c-9d0a-b34aa4505dbd service nova] Enqueued Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_rules [ 712.544988] env[65553]: INFO networking_nsxv3.common.synchronization [req-ec323381-1f5a-4004-aa53-24ed06ea75a2 req-7e47d3a9-e247-402c-9d0a-b34aa4505dbd service nova] Enqueued Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 712.544988] env[65553]: INFO networking_nsxv3.common.synchronization [req-ec323381-1f5a-4004-aa53-24ed06ea75a2 req-7e47d3a9-e247-402c-9d0a-b34aa4505dbd service nova] Enqueued Resource ID: 3f6b4ed9-0012-498e-91bb-e0b39da30395 with Priority: HIGHEST for action port [ 712.544988] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_rules [ 712.544988] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 712.544988] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f6b4ed9-0012-498e-91bb-e0b39da30395 with Priority: HIGHEST for action port [ 712.544988] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.545863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.545863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.545863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.545863] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.547743] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.547858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.548202] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f6b4ed9-0012-498e-91bb-e0b39da30395 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.548349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f6b4ed9-0012-498e-91bb-e0b39da30395" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.548431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f6b4ed9-0012-498e-91bb-e0b39da30395" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.549420] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f6b4ed9-0012-498e-91bb-e0b39da30395" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.549420] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f6b4ed9-0012-498e-91bb-e0b39da30395',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.774320] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30f1992f-8f85-4326-932f-434571d97d70 in Status: SUCCESS [ 712.774489] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30f1992f-8f85-4326-932f-434571d97d70 deletion is rescheduled due to dependency. [ 712.774715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.050842] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.050989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.052391] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f6b4ed9-0012-498e-91bb-e0b39da30395 with status ACTIVE [ 713.052592] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.052793] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.052865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.053160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.053272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.053464] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.053558] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.053627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.053790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.053873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.054306] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.054459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.054541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.054714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.058343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.058343] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f6b4ed9-0012-498e-91bb-e0b39da30395 is going to be updated. [ 713.089411] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.089570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.089642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.089858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.089997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.090177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f6b4ed9-0012-498e-91bb-e0b39da30395" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.269596] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 713.270028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.270028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.270234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.270438] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.270595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.270677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.270837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.270922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.271016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.271140] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.719823] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: SUCCESS [ 713.719823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.774270] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.777069] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.777069] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.777069] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.777069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.777631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.777631] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.280523] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a86c04db-ddf8-419d-8a90-125d10e637f6: rpc.has_security_group_logging(os_id): False [ 714.310699] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.310830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.310911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.311178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.311306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.311625] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.311759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.311870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.311968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.312055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.312264] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.312361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.312423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.312570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.312648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.312854] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.312902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.312969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.313924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.314040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.314164] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be created. [ 714.340582] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: SUCCESS [ 714.341311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.343032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.343288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.343514] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.343684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.343778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.343969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.347644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.347644] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.392026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.392026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.392026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.392026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.392026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.404785] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 714.854895] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.903570] env[65553]: INFO networking_nsxv3.common.synchronization [req-1132dba0-0d36-43e5-98c3-004c2595dffa req-1d0162ae-0468-4758-bc01-149ab256a989 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 714.904445] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 714.904445] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.904575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.904619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.905138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.908043] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.908226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.908300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.908734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.908734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.908734] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.180030] env[65553]: INFO networking_nsxv3.common.synchronization [req-8cddb31b-fa8e-4a47-b1e7-1651931b88c6 req-4080a788-d455-4cd3-b1de-f244dfee106a tempest-ImagesTestJSON-1118693169 tempest-ImagesTestJSON-1118693169-project-member] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 715.180030] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 715.180030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.180030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.180030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.180930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.181438] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.183818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.183818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.183818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.183818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.183818] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.359732] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.382388] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.382568] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.382691] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.382961] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.383227] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.383729] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.383729] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.383729] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.383874] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.385867] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.389020] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.389020] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.389020] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.389020] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.389020] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.389020] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.409481] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.409659] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.409781] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.409955] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.410299] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-2cdfce49-24a7-4967-93fc-018930a6268c taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.410472] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-2cdfce49-24a7-4967-93fc-018930a6268c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.410572] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-2cdfce49-24a7-4967-93fc-018930a6268c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.410947] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-2cdfce49-24a7-4967-93fc-018930a6268c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.411049] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cdfce49-24a7-4967-93fc-018930a6268c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.412131] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.412282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.412321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.412476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.412567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.412825] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.412923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.412923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.413093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.413171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.413253] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 already deleted. [ 715.413340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.578759] env[65553]: INFO networking_nsxv3.common.synchronization [req-6f9ed2bf-6ab7-41db-8af0-615856b99b55 req-3bc317a9-663f-4b71-9f40-1d6fe5139cf7 tempest-MultipleCreateTestJSON-1937935220 tempest-MultipleCreateTestJSON-1937935220-project-member] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 715.579694] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 715.580230] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.580399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.580532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.580779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.581012] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.581182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.581270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.581497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.581629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.581775] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.687209] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.687392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.687439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.687660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.687757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.687950] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.688061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.688112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.688261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.688335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.688417] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 715.717493] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.717700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.717700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.717906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.718043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.733756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 715.862387] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.862576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.862665] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.862904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.863030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.863147] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfefe395-d857-43f0-952f-7a8984da2f70 is going to be updated. [ 715.901249] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.901476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.901476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.901853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.902072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.916332] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.916332] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.916332] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.916646] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.916820] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.917365] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 2cdfce49-24a7-4967-93fc-018930a6268c not found, creating... [ 715.917365] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.917547] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.917696] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.918077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.918308] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.918798] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.919068] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.919241] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.919489] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.919635] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.919779] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 2cdfce49-24a7-4967-93fc-018930a6268c is going to be created. [ 715.921847] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: IN_PROGRESS for 2s [ 715.952131] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.952623] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.952985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.953439] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.953814] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.954183] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-2cdfce49-24a7-4967-93fc-018930a6268c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.085048] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.420285] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 716.420561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.587839] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.672261] env[65553]: INFO networking_nsxv3.common.synchronization [req-1132dba0-0d36-43e5-98c3-004c2595dffa req-2b01772e-2b45-4e9e-8bd9-4b42c90e1bb9 service nova] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_rules [ 716.672261] env[65553]: INFO networking_nsxv3.common.synchronization [req-1132dba0-0d36-43e5-98c3-004c2595dffa req-2b01772e-2b45-4e9e-8bd9-4b42c90e1bb9 service nova] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 716.672261] env[65553]: INFO networking_nsxv3.common.synchronization [req-1132dba0-0d36-43e5-98c3-004c2595dffa req-2b01772e-2b45-4e9e-8bd9-4b42c90e1bb9 service nova] Enqueued Resource ID: 2cdfce49-24a7-4967-93fc-018930a6268c with Priority: HIGHEST for action port [ 716.672261] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_rules [ 716.672261] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 716.672261] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cdfce49-24a7-4967-93fc-018930a6268c with Priority: HIGHEST for action port [ 716.672261] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.672261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.672261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.672261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.672261] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.673971] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.674224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.674706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.675065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.675327] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.675522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.679129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.679424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.679621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.679832] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.682342] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cdfce49-24a7-4967-93fc-018930a6268c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.682342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cdfce49-24a7-4967-93fc-018930a6268c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.682342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cdfce49-24a7-4967-93fc-018930a6268c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.682342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cdfce49-24a7-4967-93fc-018930a6268c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.682342] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cdfce49-24a7-4967-93fc-018930a6268c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.090025] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.090168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.090276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.090445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.090533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.090629] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 717.122128] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.122317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.122385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.122693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.122845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.133074] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 717.182845] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.182998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.183195] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.184375] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cdfce49-24a7-4967-93fc-018930a6268c with status ACTIVE [ 717.184717] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.184717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.184922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.185131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.185226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.185430] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.185505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.185593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.185715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.185848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.186987] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.187154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.187218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.187377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.187456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.187548] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cdfce49-24a7-4967-93fc-018930a6268c is going to be updated. [ 717.215996] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.215996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.215996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.215996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.215996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.215996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cdfce49-24a7-4967-93fc-018930a6268c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.690693] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.748441] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 717.748625] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 deletion is rescheduled due to dependency. [ 717.748733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.932021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: SUCCESS [ 717.932346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.932583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.932851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.933129] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.933342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.933444] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.933620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.933730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.933843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.933960] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.192253] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.192410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.192481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.193597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.193597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.193597] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be created. [ 718.218716] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.218716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.218716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.218934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.219049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.230294] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: UNINITIALIZED for 2s [ 718.437377] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.437578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.437630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.437863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.438054] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.438154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.438217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.438379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.438469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.438565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.438708] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.438809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.438869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.439015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.439170] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.439259] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.439320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.439463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.439552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.439621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.439732] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.602106] env[65553]: INFO networking_nsxv3.common.synchronization [None req-cb0c4f4f-4752-4429-90df-ebe834f39650 None None] Enqueued Resource ID: 714cd0a6-48ef-4890-b6a2-261fd587a200 with Priority: HIGHEST for action port [ 718.602106] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714cd0a6-48ef-4890-b6a2-261fd587a200 with Priority: HIGHEST for action port [ 718.602470] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-714cd0a6-48ef-4890-b6a2-261fd587a200 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.602524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-714cd0a6-48ef-4890-b6a2-261fd587a200" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.602564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-714cd0a6-48ef-4890-b6a2-261fd587a200" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.603731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-714cd0a6-48ef-4890-b6a2-261fd587a200" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.603731] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('714cd0a6-48ef-4890-b6a2-261fd587a200',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.944044] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfefe395-d857-43f0-952f-7a8984da2f70: rpc.has_security_group_logging(os_id): False [ 718.968033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.968230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.968275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.968485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.968587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.968819] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.968910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.968973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.969145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.969225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.969400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.969494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.969553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.969695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.971033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.971033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.971033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.971033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.971033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.971033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.971033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfefe395-d857-43f0-952f-7a8984da2f70 is going to be updated. [ 719.044957] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.045262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.045334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.045543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.045683] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.060207] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: IN_PROGRESS for 2s [ 719.106696] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 714cd0a6-48ef-4890-b6a2-261fd587a200 [ 719.107168] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.107273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.107323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.107562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.107651] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.107886] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:714cd0a6-48ef-4890-b6a2-261fd587a200 already deleted. [ 719.107886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-714cd0a6-48ef-4890-b6a2-261fd587a200" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.148508] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 719.149113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.618909] env[65553]: INFO networking_nsxv3.common.synchronization [req-eb8143fc-199b-4177-bdfd-09aa88718bbe req-bb999b8f-2f31-4af1-b2bf-334239d2c99a tempest-ServersTestFqdnHostnames-1268563277 tempest-ServersTestFqdnHostnames-1268563277-project-member] Enqueued Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_members [ 719.619618] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_members [ 719.620235] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.620639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.620747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.621074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.621527] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.621527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.621527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.621700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.621700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.621769] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.116561] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.117363] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.118337] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.118337] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.118487] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.119069] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.119069] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.119384] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.119584] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.119873] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.120011] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.120876] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.120876] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.120876] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.120876] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.121060] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.124961] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.125094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.125094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.125305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.125395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.125639] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.125712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.125862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.125912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.125960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.126047] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd already deleted. [ 720.126130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.152945] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.152945] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 720.152945] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.153238] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.153434] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.153605] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.153716] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.154075] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.154203] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.245540] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 720.245851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.246215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.246656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.246872] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.247178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.247178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.247318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.247385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.248363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.248363] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.261186] env[65553]: INFO networking_nsxv3.common.synchronization [req-4017755e-be30-4a9d-bd44-81a4644d72fb req-920f3324-9284-4219-9bf0-58803e680107 tempest-MultipleCreateTestJSON-1937935220 tempest-MultipleCreateTestJSON-1937935220-project-member] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 720.262046] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 720.262400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.262526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.262618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.262842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.263120] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.263640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.263727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.263839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.263926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.264038] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.659501] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.659501] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.659720] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.659931] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.660684] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.660684] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8 not found, creating... [ 720.660684] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.660684] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.660897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.661011] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.661202] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.661491] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.661657] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.661769] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.662754] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.662936] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.663627] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8 is going to be created. [ 720.690743] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.691052] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.691261] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.694593] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.694593] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.694593] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.753658] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.753894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.754029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.754257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.754484] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.754977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.754977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.754977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.755135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.755215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.755397] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.755522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.755607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.755884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.756117] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.756240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.756327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.756508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.756681] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.756737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.756837] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.769446] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.769667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.769736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.769962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.770091] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.772932] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.772932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.772932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.772932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.772932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.772932] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 720.830460] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.830460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.830460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.830757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.830831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.843266] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 721.052016] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d69333fc-a3a7-4736-9304-02a3e9e0128e None None] Enqueued Resource ID: 85e04204-3c68-4997-acf9-c7185dcf8484 with Priority: HIGHEST for action port [ 721.052578] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85e04204-3c68-4997-acf9-c7185dcf8484 with Priority: HIGHEST for action port [ 721.052896] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-85e04204-3c68-4997-acf9-c7185dcf8484 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.053154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85e04204-3c68-4997-acf9-c7185dcf8484" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.053154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85e04204-3c68-4997-acf9-c7185dcf8484" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.053373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85e04204-3c68-4997-acf9-c7185dcf8484" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.053452] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e04204-3c68-4997-acf9-c7185dcf8484',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.082029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: SUCCESS [ 721.082215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.262209] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4ee4c50-7cd1-464f-8791-a617053e06f6: rpc.has_security_group_logging(os_id): False [ 721.297719] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.298522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.298772] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.299169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.299407] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.299829] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.300093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.300342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.300760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.300984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.301388] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.301654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.301817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.302148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.302325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.302630] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.302909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.303082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.303345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.303528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.303756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be created. [ 721.399232] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.399232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.399232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.399232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.399232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.417215] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 721.556433] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85e04204-3c68-4997-acf9-c7185dcf8484 [ 721.556712] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.556870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.556961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.557251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.557377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.557478] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85e04204-3c68-4997-acf9-c7185dcf8484 already deleted. [ 721.557575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85e04204-3c68-4997-acf9-c7185dcf8484" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.567529] env[65553]: INFO networking_nsxv3.common.synchronization [req-eb8143fc-199b-4177-bdfd-09aa88718bbe req-14640864-e3b3-4f75-ba0b-89e1b14a06c8 service nova] Enqueued Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_rules [ 721.567992] env[65553]: INFO networking_nsxv3.common.synchronization [req-eb8143fc-199b-4177-bdfd-09aa88718bbe req-14640864-e3b3-4f75-ba0b-89e1b14a06c8 service nova] Enqueued Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_members [ 721.567992] env[65553]: INFO networking_nsxv3.common.synchronization [req-eb8143fc-199b-4177-bdfd-09aa88718bbe req-14640864-e3b3-4f75-ba0b-89e1b14a06c8 service nova] Enqueued Resource ID: ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8 with Priority: HIGHEST for action port [ 721.568440] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_rules [ 721.568605] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_members [ 721.568768] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8 with Priority: HIGHEST for action port [ 721.568984] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.569156] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.569204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.569441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.569441] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.570668] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.570668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.570787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.570937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.571105] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.571202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.571265] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.571409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.571493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.571607] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.572708] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.573022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.573022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.573112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.573196] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.919078] env[65553]: INFO networking_nsxv3.common.synchronization [req-bab0114c-3393-4e69-a582-a9efdabf49cc req-aa9b9881-d003-43f2-980d-61598fc59f4b tempest-FloatingIPsAssociationNegativeTestJSON-1299180993 tempest-FloatingIPsAssociationNegativeTestJSON-1299180993-project-member] Enqueued Resource ID: b5b58f96-24da-4b03-965a-558253f0ed7f with Priority: HIGHEST for action security_group_members [ 721.919650] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b58f96-24da-4b03-965a-558253f0ed7f with Priority: HIGHEST for action security_group_members [ 721.920241] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5b58f96-24da-4b03-965a-558253f0ed7f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.920422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.920606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.920805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.921049] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.921203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.921299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.921522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.921656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.921796] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5b58f96-24da-4b03-965a-558253f0ed7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.078400] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.078400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.078400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.078400] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8 with status ACTIVE [ 722.078400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.078400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.078400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.078400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.078400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.078400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.078400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.078400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.078400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.078400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.079042] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.079042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.079042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.079042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.079042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.079607] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8 is going to be updated. [ 722.102565] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.102565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.102565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.102565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.102565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.102565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea9eec5d-28dd-45ef-adb9-8e720d4a8ba8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.426986] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.427266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.427266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.427886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.427886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.427886] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.427886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.427886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.428120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.428120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.428120] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b58f96-24da-4b03-965a-558253f0ed7f is going to be updated. [ 722.458730] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.458730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.458946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.459018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.460580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.468762] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b58f96-24da-4b03-965a-558253f0ed7f in Status: IN_PROGRESS for 2s [ 722.582136] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.854702] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 722.854702] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 deletion is rescheduled due to dependency. [ 722.854702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.085559] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.085559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.085759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.089043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.089043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.089043] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd is going to be created. [ 723.126533] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.127668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.127668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.127668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.127831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.139626] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd in Status: UNINITIALIZED for 2s [ 723.430619] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 723.430897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.973099] env[65553]: INFO networking_nsxv3.common.synchronization [req-ed5922f6-ce00-4a88-b244-4c458464643f req-c837f538-2500-4066-ba69-dcc5145d47ad tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 723.973252] env[65553]: INFO networking_nsxv3.common.synchronization [req-ed5922f6-ce00-4a88-b244-4c458464643f req-c837f538-2500-4066-ba69-dcc5145d47ad tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_members [ 723.973873] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 723.974088] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_members [ 723.974471] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.974826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.974826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.975065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.975501] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.975501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.975501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.975664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.975664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.975877] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.977134] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.977134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.977134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.977278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.977324] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.977390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.977922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.977922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.977922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.977922] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.025120] env[65553]: INFO networking_nsxv3.common.synchronization [req-ed5922f6-ce00-4a88-b244-4c458464643f req-c837f538-2500-4066-ba69-dcc5145d47ad tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_rules [ 724.025317] env[65553]: INFO networking_nsxv3.common.synchronization [req-ed5922f6-ce00-4a88-b244-4c458464643f req-c837f538-2500-4066-ba69-dcc5145d47ad tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_members [ 724.025493] env[65553]: INFO networking_nsxv3.common.synchronization [req-ed5922f6-ce00-4a88-b244-4c458464643f req-c837f538-2500-4066-ba69-dcc5145d47ad tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 724.025747] env[65553]: INFO networking_nsxv3.common.synchronization [req-ed5922f6-ce00-4a88-b244-4c458464643f req-c837f538-2500-4066-ba69-dcc5145d47ad tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 724.025747] env[65553]: INFO networking_nsxv3.common.synchronization [req-ed5922f6-ce00-4a88-b244-4c458464643f req-c837f538-2500-4066-ba69-dcc5145d47ad tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: d21ff243-949d-403c-aad7-3c2cd67bf914 with Priority: HIGHEST for action port [ 724.026432] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_rules [ 724.026594] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 724.026698] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21ff243-949d-403c-aad7-3c2cd67bf914 with Priority: HIGHEST for action port [ 724.026793] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_members [ 724.026897] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 724.027265] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.027448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.027531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.027809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.027862] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.028839] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.028954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.029058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.029264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.029347] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.030351] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d21ff243-949d-403c-aad7-3c2cd67bf914 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.030530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.030648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.031442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.031442] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d21ff243-949d-403c-aad7-3c2cd67bf914',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.031806] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.031909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.032166] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.032345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.479987] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.481900] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5b58f96-24da-4b03-965a-558253f0ed7f in Status: SUCCESS [ 724.482114] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5b58f96-24da-4b03-965a-558253f0ed7f deletion is rescheduled due to dependency. [ 724.482196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.482409] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.533836] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.534038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.534305] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.534397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.534537] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d21ff243-949d-403c-aad7-3c2cd67bf914 with status ACTIVE [ 724.534688] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.534802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.535025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.535289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.535386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.535577] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.535680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.535731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.535934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.536041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.536316] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.536456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.536550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.536727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.536809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.536898] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d21ff243-949d-403c-aad7-3c2cd67bf914 is going to be updated. [ 724.559368] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.559558] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.559558] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.559677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.559844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.560030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.984747] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.985884] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.149927] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd in Status: SUCCESS [ 725.150182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.150349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.150579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.150773] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.150892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.150973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.151157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.151230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.151322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.151411] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.488557] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.488885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.488885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.489000] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.489139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.489309] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 725.490842] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.491011] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.491106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.491300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.491402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.491504] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 330e4cbb-c145-4a73-968c-26c6765a2388 is going to be created. [ 725.520147] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.520283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.520954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.520954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.520954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.524881] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.525085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.526197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.526197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.526197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.539064] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: UNINITIALIZED for 2s [ 725.539879] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 725.654206] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.134243] env[65553]: INFO networking_nsxv3.common.synchronization [None req-a952fc4d-c35a-4ea9-9f01-3a7628ef5acf None None] Enqueued Resource ID: 2b3ff3b4-1a03-4390-962b-961b05b66243 with Priority: HIGHEST for action port [ 726.135271] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b3ff3b4-1a03-4390-962b-961b05b66243 with Priority: HIGHEST for action port [ 726.135271] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b3ff3b4-1a03-4390-962b-961b05b66243 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.135271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b3ff3b4-1a03-4390-962b-961b05b66243" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.135271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b3ff3b4-1a03-4390-962b-961b05b66243" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.135471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b3ff3b4-1a03-4390-962b-961b05b66243" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.135544] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b3ff3b4-1a03-4390-962b-961b05b66243',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.156395] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd: rpc.has_security_group_logging(os_id): False [ 726.178398] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.180118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.180118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.180118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.180118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.180118] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.180118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.180118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.180118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.180118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.180118] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd is going to be created. [ 726.247299] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.247299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.247299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.247299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.247299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.263394] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd in Status: IN_PROGRESS for 2s [ 726.639593] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b3ff3b4-1a03-4390-962b-961b05b66243 [ 726.639593] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.639593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.639593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.639593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.639593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.639593] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b3ff3b4-1a03-4390-962b-961b05b66243 already deleted. [ 726.639593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b3ff3b4-1a03-4390-962b-961b05b66243" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.918751] env[65553]: INFO networking_nsxv3.common.synchronization [req-d76a24cd-68f7-41f1-b5bc-8ee8d8d33361 req-3ffce393-cc67-406c-8597-ddfb0119ac79 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_members [ 726.921102] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_members [ 726.921102] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-28be331c-2041-41ac-9f2a-5746e8762908 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.921102] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.921311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.921879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.921879] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.921987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.922081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.922273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.922409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.922564] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28be331c-2041-41ac-9f2a-5746e8762908',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.952725] env[65553]: INFO networking_nsxv3.common.synchronization [req-36fe9a1d-9b6e-48f1-9592-061ea2cf4a94 req-ec2e8c63-5e07-4963-a68d-b16fa6256e5a tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGHEST for action security_group_members [ 726.953515] env[65553]: INFO networking_nsxv3.common.synchronization [req-36fe9a1d-9b6e-48f1-9592-061ea2cf4a94 req-ec2e8c63-5e07-4963-a68d-b16fa6256e5a tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 726.953764] env[65553]: INFO networking_nsxv3.common.synchronization [req-36fe9a1d-9b6e-48f1-9592-061ea2cf4a94 req-ec2e8c63-5e07-4963-a68d-b16fa6256e5a tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_members [ 726.954514] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGHEST for action security_group_members [ 726.954770] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 726.955989] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_members [ 726.955989] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b16119-4a62-4859-895e-b0f3732128ff taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.955989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.955989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.955989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.955989] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.956529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.956673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.956902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.957155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.957496] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.959030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.959226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.961987] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.961987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.016034] env[65553]: INFO networking_nsxv3.common.synchronization [req-36fe9a1d-9b6e-48f1-9592-061ea2cf4a94 req-ec2e8c63-5e07-4963-a68d-b16fa6256e5a tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGHEST for action security_group_rules [ 727.016034] env[65553]: INFO networking_nsxv3.common.synchronization [req-36fe9a1d-9b6e-48f1-9592-061ea2cf4a94 req-ec2e8c63-5e07-4963-a68d-b16fa6256e5a tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGHEST for action security_group_members [ 727.016034] env[65553]: INFO networking_nsxv3.common.synchronization [req-36fe9a1d-9b6e-48f1-9592-061ea2cf4a94 req-ec2e8c63-5e07-4963-a68d-b16fa6256e5a tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_rules [ 727.016034] env[65553]: INFO networking_nsxv3.common.synchronization [req-36fe9a1d-9b6e-48f1-9592-061ea2cf4a94 req-ec2e8c63-5e07-4963-a68d-b16fa6256e5a tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_members [ 727.016034] env[65553]: INFO networking_nsxv3.common.synchronization [req-36fe9a1d-9b6e-48f1-9592-061ea2cf4a94 req-ec2e8c63-5e07-4963-a68d-b16fa6256e5a tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 727.016034] env[65553]: INFO networking_nsxv3.common.synchronization [req-36fe9a1d-9b6e-48f1-9592-061ea2cf4a94 req-ec2e8c63-5e07-4963-a68d-b16fa6256e5a tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 727.016034] env[65553]: INFO networking_nsxv3.common.synchronization [req-36fe9a1d-9b6e-48f1-9592-061ea2cf4a94 req-ec2e8c63-5e07-4963-a68d-b16fa6256e5a tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: d21ff243-949d-403c-aad7-3c2cd67bf914 with Priority: HIGHEST for action port [ 727.017092] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGHEST for action security_group_rules [ 727.017404] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_rules [ 727.017591] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 727.017767] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21ff243-949d-403c-aad7-3c2cd67bf914 with Priority: HIGHEST for action port [ 727.017950] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 727.018170] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGHEST for action security_group_members [ 727.018361] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_members [ 727.020022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18b16119-4a62-4859-895e-b0f3732128ff taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.020022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.020022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.020022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.020022] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.023036] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.023036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.023036] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.023036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.023036] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d21ff243-949d-403c-aad7-3c2cd67bf914 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.023036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.023036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.023036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.023036] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d21ff243-949d-403c-aad7-3c2cd67bf914',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.023036] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.023036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.023036] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b16119-4a62-4859-895e-b0f3732128ff taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.023036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.023036] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.023036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.376267] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.376489] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.376559] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.376881] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.377137] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.377307] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.377413] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.377614] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.377778] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.377994] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.378122] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.378248] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.378382] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.378531] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.378662] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.378820] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.401275] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.401409] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.401584] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.401662] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.402573] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-8ebd10c9-5b19-42db-b47d-65529a3089ff taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.402573] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-8ebd10c9-5b19-42db-b47d-65529a3089ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.402573] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-8ebd10c9-5b19-42db-b47d-65529a3089ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.402573] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-8ebd10c9-5b19-42db-b47d-65529a3089ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.402858] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ebd10c9-5b19-42db-b47d-65529a3089ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.430083] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.430083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.430083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.430083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.430083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.430083] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.430083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.430083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.430083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.430083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.430083] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28be331c-2041-41ac-9f2a-5746e8762908 already deleted. [ 727.430730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.462832] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.527147] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d21ff243-949d-403c-aad7-3c2cd67bf914 with status ACTIVE [ 727.527438] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.527582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.527790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.528050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.528198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.528333] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.528437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.528499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.528654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.528734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.529252] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.529353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.529414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.529566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.529645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.529729] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d21ff243-949d-403c-aad7-3c2cd67bf914 is going to be updated. [ 727.530867] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b16119-4a62-4859-895e-b0f3732128ff taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.530965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.556198] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: SUCCESS [ 727.556413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.556580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.556789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.556973] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.557105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.557178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.557418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.557502] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.557604] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.559374] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.559495] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.559562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.559714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.559839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.559977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d21ff243-949d-403c-aad7-3c2cd67bf914" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.560625] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 727.560834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.560930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.561109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.561262] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.561365] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.561428] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.561567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.561644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.561732] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.907557] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.908039] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.908039] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.908390] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.908476] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.908687] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 8ebd10c9-5b19-42db-b47d-65529a3089ff not found, creating... [ 727.908965] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.909163] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.909276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.909522] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.909651] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.909955] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.910124] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.910233] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.910448] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.910635] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.910890] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 8ebd10c9-5b19-42db-b47d-65529a3089ff is going to be created. [ 727.935759] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.935984] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.936119] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.936387] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.936600] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.936812] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-8ebd10c9-5b19-42db-b47d-65529a3089ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.965138] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.065053] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.067043] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.277882] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd in Status: SUCCESS [ 728.278211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.470129] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.471191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.471281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.473241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.473241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.473241] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b16119-4a62-4859-895e-b0f3732128ff is going to be created. [ 728.504648] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.504648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.504648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.504648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.504648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.508531] env[65553]: INFO networking_nsxv3.common.synchronization [None req-23028b85-2f11-4ee7-a0eb-b6f64c27b4ba None None] Enqueued Resource ID: e63f3f0e-56da-4844-9469-71f295d92362 with Priority: HIGHEST for action port [ 728.509685] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e63f3f0e-56da-4844-9469-71f295d92362 with Priority: HIGHEST for action port [ 728.510203] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e63f3f0e-56da-4844-9469-71f295d92362 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.510459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e63f3f0e-56da-4844-9469-71f295d92362" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.510626] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e63f3f0e-56da-4844-9469-71f295d92362" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.510967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e63f3f0e-56da-4844-9469-71f295d92362" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.511169] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e63f3f0e-56da-4844-9469-71f295d92362',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.519788] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b16119-4a62-4859-895e-b0f3732128ff in Status: UNINITIALIZED for 2s [ 728.568407] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.570119] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.769124] env[65553]: INFO networking_nsxv3.common.synchronization [req-d76a24cd-68f7-41f1-b5bc-8ee8d8d33361 req-1b9ffe10-aae9-46c6-8ed7-5950eef76d0f service nova] Enqueued Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_rules [ 728.769124] env[65553]: INFO networking_nsxv3.common.synchronization [req-d76a24cd-68f7-41f1-b5bc-8ee8d8d33361 req-1b9ffe10-aae9-46c6-8ed7-5950eef76d0f service nova] Enqueued Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_members [ 728.769124] env[65553]: INFO networking_nsxv3.common.synchronization [req-d76a24cd-68f7-41f1-b5bc-8ee8d8d33361 req-1b9ffe10-aae9-46c6-8ed7-5950eef76d0f service nova] Enqueued Resource ID: 8ebd10c9-5b19-42db-b47d-65529a3089ff with Priority: HIGHEST for action port [ 728.769124] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_rules [ 728.769124] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_members [ 728.769124] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ebd10c9-5b19-42db-b47d-65529a3089ff with Priority: HIGHEST for action port [ 728.769124] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28be331c-2041-41ac-9f2a-5746e8762908 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.769124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.769989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.770339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.770669] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28be331c-2041-41ac-9f2a-5746e8762908',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.774367] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-28be331c-2041-41ac-9f2a-5746e8762908 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.774544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.774794] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.774870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.775028] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.775137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.775191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.775352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.775474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.775532] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28be331c-2041-41ac-9f2a-5746e8762908',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.776453] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ebd10c9-5b19-42db-b47d-65529a3089ff taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.777648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ebd10c9-5b19-42db-b47d-65529a3089ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.777648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ebd10c9-5b19-42db-b47d-65529a3089ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.777648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ebd10c9-5b19-42db-b47d-65529a3089ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.777648] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ebd10c9-5b19-42db-b47d-65529a3089ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.014412] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e63f3f0e-56da-4844-9469-71f295d92362 [ 729.014769] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.016236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.016236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.016236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.016236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.016236] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e63f3f0e-56da-4844-9469-71f295d92362 already deleted. [ 729.016236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e63f3f0e-56da-4844-9469-71f295d92362" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.071656] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.072043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.072244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.073262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.073478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.073680] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 330e4cbb-c145-4a73-968c-26c6765a2388 is going to be updated. [ 729.079283] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.079283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.079283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.079283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.079283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.079283] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 729.101538] env[65553]: INFO networking_nsxv3.common.synchronization [None req-1e665990-6506-4823-893d-b71deb85d5bd None None] Enqueued Resource ID: 1b851da0-2ed8-46a1-b8ff-12441f80ce74 with Priority: HIGHEST for action port [ 729.102258] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b851da0-2ed8-46a1-b8ff-12441f80ce74 with Priority: HIGHEST for action port [ 729.102591] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b851da0-2ed8-46a1-b8ff-12441f80ce74 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.102724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b851da0-2ed8-46a1-b8ff-12441f80ce74" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.102789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b851da0-2ed8-46a1-b8ff-12441f80ce74" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.104432] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b851da0-2ed8-46a1-b8ff-12441f80ce74" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.104548] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b851da0-2ed8-46a1-b8ff-12441f80ce74',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.119383] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.119575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.119645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.121071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.121313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.124605] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.124737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.124806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.127017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.129118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.141857] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 729.142740] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: IN_PROGRESS for 2s [ 729.278983] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-28be331c-2041-41ac-9f2a-5746e8762908 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.279153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.280985] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28be331c-2041-41ac-9f2a-5746e8762908',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.281988] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ebd10c9-5b19-42db-b47d-65529a3089ff with status ACTIVE [ 729.282950] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.283419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.283419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.284306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.284396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.284979] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.284979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.284979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.285246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.285390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.285571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.285707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.285767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.285976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.286070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.286175] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ebd10c9-5b19-42db-b47d-65529a3089ff is going to be updated. [ 729.349936] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.350153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.350216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.351559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.351559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.351559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ebd10c9-5b19-42db-b47d-65529a3089ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.610442] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b851da0-2ed8-46a1-b8ff-12441f80ce74 [ 729.610730] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.610852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.610928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.611120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.611241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.611342] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b851da0-2ed8-46a1-b8ff-12441f80ce74 already deleted. [ 729.611423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b851da0-2ed8-46a1-b8ff-12441f80ce74" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.789311] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28be331c-2041-41ac-9f2a-5746e8762908',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.953806] env[65553]: INFO networking_nsxv3.common.synchronization [req-1c19032d-04fb-482c-a9a3-86f7593ab9f5 req-7d83400c-ded7-4e30-8a01-e0f34eae16ba tempest-ServerAddressesTestJSON-1715630683 tempest-ServerAddressesTestJSON-1715630683-project-member] Enqueued Resource ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 with Priority: HIGHEST for action security_group_members [ 729.953806] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 with Priority: HIGHEST for action security_group_members [ 729.954154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.954291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.954360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.954628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.954796] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.954929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.954997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.955151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.955236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.955330] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7d6f932-0d6e-4b85-a4f1-f60e841549d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.294114] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.294491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.294491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.294567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.294639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.294735] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28be331c-2041-41ac-9f2a-5746e8762908 is going to be created. [ 730.326959] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.327166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.327210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.327718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.327718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.340604] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28be331c-2041-41ac-9f2a-5746e8762908 in Status: UNINITIALIZED for 2s [ 730.457869] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.458036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.458083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.458309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.458405] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.458607] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.458705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.458769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.458915] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.459027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.459123] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 is going to be updated. [ 730.493091] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.493579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.494190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.494670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.495530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.510039] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 in Status: IN_PROGRESS for 2s [ 730.532427] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b16119-4a62-4859-895e-b0f3732128ff in Status: SUCCESS [ 730.533221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.533221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.533221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.533889] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.534018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.534100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.535902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.535902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.535902] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.039857] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.157357] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: SUCCESS [ 731.157580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.158432] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 731.158612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.159143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.160589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.160792] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.160894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.160972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.161160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.161301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.161380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.161427] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.162226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.162499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.162585] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.162668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.162718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.162845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.163072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.163072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.163201] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.164023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.164228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.166252] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.166252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.166252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.166252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.166252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.166252] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.166252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.166252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.166252] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.166252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.166252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.166252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.166252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.166252] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.543887] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.669516] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.669516] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.669516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.669516] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.670286] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.047465] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.047639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.047713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.047962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.048089] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.048222] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b16119-4a62-4859-895e-b0f3732128ff is going to be updated. [ 732.090753] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.090753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.090753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.090753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.090753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.102792] env[65553]: INFO networking_nsxv3.common.synchronization [None req-01cabced-5f79-4d82-9369-bdf06cefabb7 None None] Enqueued Resource ID: 75cda4f8-03ad-49af-8dc5-a6334cb0d90b with Priority: HIGHEST for action port [ 732.104600] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b16119-4a62-4859-895e-b0f3732128ff in Status: IN_PROGRESS for 2s [ 732.104600] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cda4f8-03ad-49af-8dc5-a6334cb0d90b with Priority: HIGHEST for action port [ 732.105054] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-75cda4f8-03ad-49af-8dc5-a6334cb0d90b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.105186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75cda4f8-03ad-49af-8dc5-a6334cb0d90b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.105253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75cda4f8-03ad-49af-8dc5-a6334cb0d90b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.105530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75cda4f8-03ad-49af-8dc5-a6334cb0d90b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.105611] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75cda4f8-03ad-49af-8dc5-a6334cb0d90b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.171894] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 330e4cbb-c145-4a73-968c-26c6765a2388: rpc.has_security_group_logging(os_id): False [ 732.173523] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.174592] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.196317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.196496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.196599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.196781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.196875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.197141] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.197285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.197341] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.197492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.198389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.198576] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 330e4cbb-c145-4a73-968c-26c6765a2388 is going to be created. [ 732.273612] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.273809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.273809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.274122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.274269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.292301] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: IN_PROGRESS for 2s [ 732.357412] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28be331c-2041-41ac-9f2a-5746e8762908 in Status: SUCCESS [ 732.357580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.357793] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.358166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.358390] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.358520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.358600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.358771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.359437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.359437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.359437] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28be331c-2041-41ac-9f2a-5746e8762908',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.521210] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 in Status: SUCCESS [ 732.521210] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d6f932-0d6e-4b85-a4f1-f60e841549d8 deletion is rescheduled due to dependency. [ 732.521210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d6f932-0d6e-4b85-a4f1-f60e841549d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.608733] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75cda4f8-03ad-49af-8dc5-a6334cb0d90b [ 732.609011] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.609143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.609220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.609470] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.609566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.609689] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75cda4f8-03ad-49af-8dc5-a6334cb0d90b already deleted. [ 732.609822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75cda4f8-03ad-49af-8dc5-a6334cb0d90b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.679756] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.679756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.679756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.679756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.679756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.679756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 330e4cbb-c145-4a73-968c-26c6765a2388 is going to be updated. [ 732.679756] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.679756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.679756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.679756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.679756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.679756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 732.710579] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.710579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.710579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.710579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.710881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.714295] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.714419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.714507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.714730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.714881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.729219] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 732.731047] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: IN_PROGRESS for 2s [ 732.862885] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28be331c-2041-41ac-9f2a-5746e8762908',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.368302] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28be331c-2041-41ac-9f2a-5746e8762908: rpc.has_security_group_logging(os_id): False [ 733.389336] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.389690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.389690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.390092] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.390163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.390459] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.392084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.392084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.392084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.392084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.392084] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28be331c-2041-41ac-9f2a-5746e8762908 is going to be created. [ 733.454039] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.454039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.454039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.454039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.454039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.468398] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28be331c-2041-41ac-9f2a-5746e8762908 in Status: IN_PROGRESS for 2s [ 734.119480] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b16119-4a62-4859-895e-b0f3732128ff in Status: SUCCESS [ 734.119870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.119917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.120127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.120324] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.120445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.120503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.120668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.120749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.120835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.120928] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.284987] env[65553]: INFO networking_nsxv3.common.synchronization [None req-c81394c5-df5e-45cd-a508-038424eb78df None None] Enqueued Resource ID: a988e1b9-adab-4481-81d8-88065a70089a with Priority: HIGHEST for action port [ 734.285758] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a988e1b9-adab-4481-81d8-88065a70089a with Priority: HIGHEST for action port [ 734.286369] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-a988e1b9-adab-4481-81d8-88065a70089a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.286518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a988e1b9-adab-4481-81d8-88065a70089a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.286633] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a988e1b9-adab-4481-81d8-88065a70089a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.286948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a988e1b9-adab-4481-81d8-88065a70089a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.287051] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a988e1b9-adab-4481-81d8-88065a70089a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.310243] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: SUCCESS [ 734.310523] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.310852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.311162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.311226] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.624469] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.743322] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 734.743322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.743789] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: SUCCESS [ 734.743955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.744117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.744784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.744784] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.744784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.744784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.745110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.745110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.746561] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.746749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.747807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.748113] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.749249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.749249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.749249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.749249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.749249] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.791648] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a988e1b9-adab-4481-81d8-88065a70089a [ 734.791648] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.791648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.791648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.791648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.791648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.791648] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a988e1b9-adab-4481-81d8-88065a70089a already deleted. [ 734.791648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a988e1b9-adab-4481-81d8-88065a70089a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.815749] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.816063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.126366] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18b16119-4a62-4859-895e-b0f3732128ff: rpc.has_security_group_logging(os_id): False [ 735.156168] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.157605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.157605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.157605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.157605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.159332] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.160299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.160299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.160773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.160881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.161033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18b16119-4a62-4859-895e-b0f3732128ff is going to be created. [ 735.222420] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.222699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.222766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.224388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.224642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.240474] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18b16119-4a62-4859-895e-b0f3732128ff in Status: IN_PROGRESS for 2s [ 735.252668] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.255240] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.485611] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28be331c-2041-41ac-9f2a-5746e8762908 in Status: SUCCESS [ 735.485611] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.758215] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.759331] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.265046] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.265046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.265046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.265046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.265046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.265046] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 330e4cbb-c145-4a73-968c-26c6765a2388 is going to be updated. [ 736.265660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.265660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.265660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.265660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.265660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.265660] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 736.300436] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.300627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.300884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.301129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.301268] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.303304] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.303446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.303500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.303728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.303880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.316492] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 736.316927] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: IN_PROGRESS for 2s [ 737.263847] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18b16119-4a62-4859-895e-b0f3732128ff in Status: SUCCESS [ 737.264082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.271935] env[65553]: INFO networking_nsxv3.common.synchronization [None req-a33ea181-0543-47cc-86f9-40aa30e65feb None None] Enqueued Resource ID: 0b341655-45c0-437d-8573-2148ef24426e with Priority: HIGHEST for action port [ 737.272636] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b341655-45c0-437d-8573-2148ef24426e with Priority: HIGHEST for action port [ 737.273556] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b341655-45c0-437d-8573-2148ef24426e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.273780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b341655-45c0-437d-8573-2148ef24426e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.273865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b341655-45c0-437d-8573-2148ef24426e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.274244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b341655-45c0-437d-8573-2148ef24426e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.274475] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b341655-45c0-437d-8573-2148ef24426e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.536202] env[65553]: INFO networking_nsxv3.common.synchronization [req-a9095755-393c-4191-801e-7ed09c43ea0c req-4c937162-e157-4376-99cb-de22a3f56d00 tempest-ServersAdminNegativeTestJSON-2073833851 tempest-ServersAdminNegativeTestJSON-2073833851-project-member] Enqueued Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 737.536202] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 737.536202] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.536202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.536202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.536202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.536202] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.536202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.536202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.536202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.536202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.536202] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.778297] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b341655-45c0-437d-8573-2148ef24426e [ 737.778297] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.778297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.778297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.778845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.778940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.779060] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b341655-45c0-437d-8573-2148ef24426e already deleted. [ 737.779142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b341655-45c0-437d-8573-2148ef24426e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.001855] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.002061] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.002181] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.002427] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.002669] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.002816] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.002925] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.004203] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.004374] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.005667] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.005799] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.005904] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.006348] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.006348] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.006348] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.006348] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.026902] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.026902] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 738.026902] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.026902] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.027364] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-dcb4de1e-2057-4757-86d6-3f0f57e3aea9 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.027464] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-dcb4de1e-2057-4757-86d6-3f0f57e3aea9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.027517] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-dcb4de1e-2057-4757-86d6-3f0f57e3aea9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.028912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-dcb4de1e-2057-4757-86d6-3f0f57e3aea9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.028912] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcb4de1e-2057-4757-86d6-3f0f57e3aea9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.040512] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.327590] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 738.327590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.327590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.327590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.328066] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.328066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.328066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.328066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.328066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.328252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.328252] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.328358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.328396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.328528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.328776] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.328896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.328973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.329296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.329296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.329372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.329467] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.332076] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: SUCCESS [ 738.332076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.332076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.332076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.332076] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.332076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.332076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.332076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.332076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.333051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.333186] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.534021] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.534021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.534021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.534021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.534021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.534021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port dcb4de1e-2057-4757-86d6-3f0f57e3aea9 not found, creating... [ 738.534021] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.534021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.534021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.534021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.534021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.535176] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.535176] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.535176] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.535176] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.535176] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.535176] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: dcb4de1e-2057-4757-86d6-3f0f57e3aea9 is going to be created. [ 738.543620] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.570799] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.571031] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.571160] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.572059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.572059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.572059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-dcb4de1e-2057-4757-86d6-3f0f57e3aea9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.715654] env[65553]: INFO networking_nsxv3.common.synchronization [req-1b77310a-cf84-4310-ba7c-9c172eafbffd req-0aead70f-55f0-4645-8538-fcb25fa91adc tempest-ListServerFiltersTestJSON-2035845723 tempest-ListServerFiltersTestJSON-2035845723-project-member] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 738.716767] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 738.716890] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.717034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.717099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.717349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.717505] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.717610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.717674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.717827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.717917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.718026] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.835248] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a86c04db-ddf8-419d-8a90-125d10e637f6: rpc.has_security_group_logging(os_id): False [ 738.836639] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.857812] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.858073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.858073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.858243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.858339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.858546] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.858645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.858708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.858857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.858937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.859156] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.859260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.859316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.859458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.859574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.859758] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.859871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.859937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.860100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.860179] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.860297] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 738.934150] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.938611] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.938700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.938947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.939122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.955319] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 739.013410] env[65553]: INFO networking_nsxv3.common.synchronization [None req-96119e78-36f7-4c39-ae63-5dbf4e029cdf tempest-MigrationsAdminTest-418950081 tempest-MigrationsAdminTest-418950081-project-member] Enqueued Resource ID: b452ddd3-104d-4e9d-b9a1-a38c74308b00 with Priority: HIGHEST for action security_group_rules [ 739.014096] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b452ddd3-104d-4e9d-b9a1-a38c74308b00 with Priority: HIGHEST for action security_group_rules [ 739.014471] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b452ddd3-104d-4e9d-b9a1-a38c74308b00 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.015100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b452ddd3-104d-4e9d-b9a1-a38c74308b00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.016351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b452ddd3-104d-4e9d-b9a1-a38c74308b00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.016351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b452ddd3-104d-4e9d-b9a1-a38c74308b00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.016351] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b452ddd3-104d-4e9d-b9a1-a38c74308b00',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.048836] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.049014] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.049129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.049482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.049482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.049702] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 is going to be updated. [ 739.086301] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.086420] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.086420] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.086729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.086821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.111096] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: IN_PROGRESS for 2s [ 739.221928] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.251670] env[65553]: INFO networking_nsxv3.common.synchronization [req-597cb911-64f1-4993-b354-87dbb1ccb5ef req-cf421cab-52ae-4563-a9e4-8d1f8ef60bc1 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 739.252269] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 739.252593] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.252783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.252875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.253274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.253363] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.253445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.253499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.253977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.253977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.253977] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.334809] env[65553]: INFO networking_nsxv3.common.synchronization [req-a9095755-393c-4191-801e-7ed09c43ea0c req-10c5d00f-5dad-456d-a321-bf03f4482dbe service nova] Enqueued Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_rules [ 739.335233] env[65553]: INFO networking_nsxv3.common.synchronization [req-a9095755-393c-4191-801e-7ed09c43ea0c req-10c5d00f-5dad-456d-a321-bf03f4482dbe service nova] Enqueued Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 739.335233] env[65553]: INFO networking_nsxv3.common.synchronization [req-a9095755-393c-4191-801e-7ed09c43ea0c req-10c5d00f-5dad-456d-a321-bf03f4482dbe service nova] Enqueued Resource ID: dcb4de1e-2057-4757-86d6-3f0f57e3aea9 with Priority: HIGHEST for action port [ 739.335797] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_rules [ 739.336508] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 739.336508] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcb4de1e-2057-4757-86d6-3f0f57e3aea9 with Priority: HIGHEST for action port [ 739.336696] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.336837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.336945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.337197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.337382] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.339554] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.339663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.339976] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcb4de1e-2057-4757-86d6-3f0f57e3aea9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.340170] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcb4de1e-2057-4757-86d6-3f0f57e3aea9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.340297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcb4de1e-2057-4757-86d6-3f0f57e3aea9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.340510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcb4de1e-2057-4757-86d6-3f0f57e3aea9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.340701] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcb4de1e-2057-4757-86d6-3f0f57e3aea9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.342054] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 330e4cbb-c145-4a73-968c-26c6765a2388: rpc.has_security_group_logging(os_id): False [ 739.371359] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.371797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.371797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.371797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.371949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.372087] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.372190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.372250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.372685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.372685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.372848] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 330e4cbb-c145-4a73-968c-26c6765a2388 is going to be updated. [ 739.394081] env[65553]: INFO networking_nsxv3.common.synchronization [None req-b17bcaec-9311-4980-aef2-fd23631e725a tempest-MigrationsAdminTest-418950081 tempest-MigrationsAdminTest-418950081-project-member] Enqueued Resource ID: b452ddd3-104d-4e9d-b9a1-a38c74308b00 with Priority: HIGHEST for action security_group_rules [ 739.395484] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b452ddd3-104d-4e9d-b9a1-a38c74308b00 with Priority: HIGHEST for action security_group_rules [ 739.396196] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b452ddd3-104d-4e9d-b9a1-a38c74308b00 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.396486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b452ddd3-104d-4e9d-b9a1-a38c74308b00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.447126] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.447359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.447722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.448369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.448369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.464537] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: IN_PROGRESS for 2s [ 739.540823] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.541016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.541073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.541313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.541418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.541536] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b452ddd3-104d-4e9d-b9a1-a38c74308b00 already deleted. [ 739.541626] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b452ddd3-104d-4e9d-b9a1-a38c74308b00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.541782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b452ddd3-104d-4e9d-b9a1-a38c74308b00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.541938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b452ddd3-104d-4e9d-b9a1-a38c74308b00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.542042] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b452ddd3-104d-4e9d-b9a1-a38c74308b00',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.724240] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.757649] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.757649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.757649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.757894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.757894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.758084] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.758195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.758360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.758562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.758622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.758946] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 739.788089] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.788377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.788377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.788632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.788696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.802656] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 739.840913] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.840913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.846418] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcb4de1e-2057-4757-86d6-3f0f57e3aea9 with status ACTIVE [ 739.846649] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.846790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.846862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.847116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.847215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.847518] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.847605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.847640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.847882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.847882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.848106] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.848209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.848274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.848417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.848513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.848605] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcb4de1e-2057-4757-86d6-3f0f57e3aea9 is going to be updated. [ 739.874178] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.874413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.874413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.874762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.874762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.874929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcb4de1e-2057-4757-86d6-3f0f57e3aea9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.064505] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.064700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.064834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.065070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.065190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.065291] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b452ddd3-104d-4e9d-b9a1-a38c74308b00 already deleted. [ 740.065501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b452ddd3-104d-4e9d-b9a1-a38c74308b00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.229159] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.229159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.229159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.229159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.229159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.229159] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be updated. [ 740.263132] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.263696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.263777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.263995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.264186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.273402] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: IN_PROGRESS for 2s [ 740.971025] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 740.971025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.971025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.971396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.971396] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.127191] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: SUCCESS [ 741.127191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.127191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.127191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.127191] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.127191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.127191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.127191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.127191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.127191] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.477347] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.477347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.477347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.477347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.477347] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.477347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.477347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.477347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.477347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.477347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.477347] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.479407] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: SUCCESS [ 741.479833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.627877] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.817807] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 741.818259] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 deletion is rescheduled due to dependency. [ 741.818562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.979517] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.979849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.979849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.980104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.980303] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.980439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.980531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.981459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.981630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.981872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.981872] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.981968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.982023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.982175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.982319] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.982411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.982471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.982610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.982691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.982951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.982951] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.132015] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.186740] env[65553]: INFO networking_nsxv3.common.synchronization [req-8837e031-8870-46e6-b2e5-3e7f1d3e721a req-4d6e521f-f2df-40fc-9e74-bc468c2d7233 tempest-FloatingIPsAssociationTestJSON-1444757961 tempest-FloatingIPsAssociationTestJSON-1444757961-project-member] Enqueued Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 742.187389] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 742.187751] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.187867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.187927] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.188275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.188437] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.188539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.188599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.189155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.189155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.189155] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.286802] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 742.287036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.485423] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a86c04db-ddf8-419d-8a90-125d10e637f6: rpc.has_security_group_logging(os_id): False [ 742.507352] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.507352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.507352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.507352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.507352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.507352] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.507352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.507352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.507352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.507352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.507981] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.507981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.507981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.508192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.509399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.509399] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.509399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.509399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.509399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.509399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.509399] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 742.572138] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.572311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.572311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.573252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.573252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.587505] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 742.633203] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.633367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.633439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.633688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.633794] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.633904] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 is going to be updated. [ 742.679108] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.679283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.679359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.679596] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.679719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.691245] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: IN_PROGRESS for 2s [ 742.691347] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.196900] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.701356] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.701548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.701582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.702201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.702201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.702201] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfefe395-d857-43f0-952f-7a8984da2f70 is going to be updated. [ 743.731124] env[65553]: INFO networking_nsxv3.common.synchronization [None req-7b784599-e8d3-47b3-b2cd-001f1f340ba7 None None] Enqueued Resource ID: a6b40799-a080-454f-8844-233562b6c23a with Priority: HIGHEST for action port [ 743.731124] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6b40799-a080-454f-8844-233562b6c23a with Priority: HIGHEST for action port [ 743.731124] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6b40799-a080-454f-8844-233562b6c23a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.731124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6b40799-a080-454f-8844-233562b6c23a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.731124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6b40799-a080-454f-8844-233562b6c23a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.731124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6b40799-a080-454f-8844-233562b6c23a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.731124] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6b40799-a080-454f-8844-233562b6c23a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.737842] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.738213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.738396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.738765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.739134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.756550] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: IN_PROGRESS for 2s [ 744.237658] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6b40799-a080-454f-8844-233562b6c23a [ 744.237658] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.237658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.237658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.237658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.237658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.237658] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6b40799-a080-454f-8844-233562b6c23a already deleted. [ 744.237658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6b40799-a080-454f-8844-233562b6c23a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.610563] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 744.610563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.702286] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: SUCCESS [ 744.702508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.702681] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.702899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.703118] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.703237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.703301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.703452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.703533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.703618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.703707] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.919393] env[65553]: INFO networking_nsxv3.common.synchronization [req-345910f9-edd7-4bac-856d-2560b6c9ee35 req-30f76eb9-5834-4032-b8ec-b3cebd348393 tempest-ServersWithSpecificFlavorTestJSON-819002853 tempest-ServersWithSpecificFlavorTestJSON-819002853-project-member] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 744.920806] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 744.921667] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.922553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.922940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.923844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.924434] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.924860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.925198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.925636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.925879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.926236] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.962605] env[65553]: INFO networking_nsxv3.common.synchronization [req-5bfd4a6c-957f-4850-afd1-e49eeec6e706 req-23e53b08-0ad9-4f45-ac94-d2647bc81d4f tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_members [ 744.963147] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGHEST for action security_group_members [ 744.963458] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5850b07-8815-476d-8023-18db057487e0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.963578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.963648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.963893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.964040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.964149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.964212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.964370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.964458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.964551] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.206249] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.206427] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.206501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.206897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.207135] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.207213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.207262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.207431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.207520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.207609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.207780] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.207873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.207930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.208087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.208257] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.208384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.208434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.208572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.208681] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.208719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.208806] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.432887] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.433383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.433383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.433461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.434656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.434656] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.434656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.434656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.434656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.434656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.434656] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a is going to be updated. [ 745.467197] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.467197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.467197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.467707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.467707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.469674] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.470406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.470675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.470941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.471060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.471288] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.471400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.471464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.471672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.471751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.471842] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5850b07-8815-476d-8023-18db057487e0 is going to be updated. [ 745.485162] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: IN_PROGRESS for 2s [ 745.510115] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.510115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.510115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.510115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.510115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.520680] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5850b07-8815-476d-8023-18db057487e0 in Status: IN_PROGRESS for 2s [ 745.630417] env[65553]: INFO networking_nsxv3.common.synchronization [req-77dfbba3-20a3-4927-b530-79eccedb6d0e req-46e7104b-0196-4da5-bc58-12096b718719 tempest-ImagesTestJSON-1118693169 tempest-ImagesTestJSON-1118693169-project-member] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 745.633157] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 745.634507] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.635275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.635275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.635275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.635407] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.635523] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.635599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.635849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.636816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.636816] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.711470] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9: rpc.has_security_group_logging(os_id): False [ 745.735841] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.736338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.737182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.737182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.737182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.737182] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.737182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.737461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.737461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.737520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.737711] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.737842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.737908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.738069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.738151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.738425] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.738524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.738666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.738767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.738797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.738906] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 is going to be updated. [ 745.764951] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: SUCCESS [ 745.764951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.840734] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.840888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.840958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.841356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.841660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.870465] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: IN_PROGRESS for 2s [ 746.035294] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.035513] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.035588] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.035800] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.036157] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.036345] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.036458] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.036676] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.036832] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.037049] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.037159] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.037508] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.037623] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.037861] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.037861] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.037974] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.061300] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.061503] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.061581] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.061755] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.062171] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-33d8ed3b-6946-4f19-9912-70ad60d4bf80 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.062301] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-33d8ed3b-6946-4f19-9912-70ad60d4bf80" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.062358] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-33d8ed3b-6946-4f19-9912-70ad60d4bf80" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.062686] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-33d8ed3b-6946-4f19-9912-70ad60d4bf80" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.062843] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33d8ed3b-6946-4f19-9912-70ad60d4bf80',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.140568] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.140723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.140952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.141055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.141123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.141307] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.141398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.141506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.141604] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.141679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.141778] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 746.173986] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.174221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.174298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.174537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.174687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.185850] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 746.255833] env[65553]: INFO networking_nsxv3.common.synchronization [None req-86560952-7238-493e-9444-6b72b82f6e24 None None] Enqueued Resource ID: 9e5b4cd0-23cd-45f3-96a3-cbaa2158a173 with Priority: HIGHEST for action port [ 746.256471] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5b4cd0-23cd-45f3-96a3-cbaa2158a173 with Priority: HIGHEST for action port [ 746.256788] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e5b4cd0-23cd-45f3-96a3-cbaa2158a173 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.256913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e5b4cd0-23cd-45f3-96a3-cbaa2158a173" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.256982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e5b4cd0-23cd-45f3-96a3-cbaa2158a173" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.257391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e5b4cd0-23cd-45f3-96a3-cbaa2158a173" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.257513] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e5b4cd0-23cd-45f3-96a3-cbaa2158a173',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.565717] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.566028] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.566386] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.566662] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.566807] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.566953] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 33d8ed3b-6946-4f19-9912-70ad60d4bf80 not found, creating... [ 746.567228] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.567401] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.567540] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.567760] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.567906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.568212] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.568365] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.568487] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.568697] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.568823] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.568969] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 33d8ed3b-6946-4f19-9912-70ad60d4bf80 is going to be created. [ 746.592757] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.593066] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.593205] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.593531] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.593799] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.594064] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-33d8ed3b-6946-4f19-9912-70ad60d4bf80" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.761719] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e5b4cd0-23cd-45f3-96a3-cbaa2158a173 [ 746.761719] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.761892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.761892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.762486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.762486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.762486] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e5b4cd0-23cd-45f3-96a3-cbaa2158a173 already deleted. [ 746.762486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e5b4cd0-23cd-45f3-96a3-cbaa2158a173" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.497403] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: SUCCESS [ 747.497603] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a deletion is rescheduled due to dependency. [ 747.497972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.534488] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5850b07-8815-476d-8023-18db057487e0 in Status: SUCCESS [ 747.534488] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5850b07-8815-476d-8023-18db057487e0 deletion is rescheduled due to dependency. [ 747.534488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.786785] env[65553]: INFO networking_nsxv3.common.synchronization [req-77dfbba3-20a3-4927-b530-79eccedb6d0e req-34f5a32d-1d23-4c87-881f-409064b53fe5 service nova] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_rules [ 747.786785] env[65553]: INFO networking_nsxv3.common.synchronization [req-77dfbba3-20a3-4927-b530-79eccedb6d0e req-34f5a32d-1d23-4c87-881f-409064b53fe5 service nova] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 747.786785] env[65553]: INFO networking_nsxv3.common.synchronization [req-77dfbba3-20a3-4927-b530-79eccedb6d0e req-34f5a32d-1d23-4c87-881f-409064b53fe5 service nova] Enqueued Resource ID: 33d8ed3b-6946-4f19-9912-70ad60d4bf80 with Priority: HIGHEST for action port [ 747.786785] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_rules [ 747.787222] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 747.787222] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d8ed3b-6946-4f19-9912-70ad60d4bf80 with Priority: HIGHEST for action port [ 747.787959] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.788088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.788499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.789440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.789549] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.790444] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.790543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.790732] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-33d8ed3b-6946-4f19-9912-70ad60d4bf80 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.790861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33d8ed3b-6946-4f19-9912-70ad60d4bf80" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.790934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33d8ed3b-6946-4f19-9912-70ad60d4bf80" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.791126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33d8ed3b-6946-4f19-9912-70ad60d4bf80" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.791210] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33d8ed3b-6946-4f19-9912-70ad60d4bf80',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.888043] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: SUCCESS [ 747.888043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.054732] env[65553]: INFO networking_nsxv3.common.synchronization [req-125a317a-a5be-40a4-9d11-3111a1ae5c56 req-4dbf9772-df9c-4707-9dd0-9ee7f498f2f7 tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 748.055714] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 748.056175] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.056400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.056479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.058085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.058085] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.058085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.058196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.058315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.058428] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.058533] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.197405] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 748.197705] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 deletion is rescheduled due to dependency. [ 748.197705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.197834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.198078] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.198263] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.198380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.198620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.198620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.198766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.198766] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.293104] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.293104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.296197] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33d8ed3b-6946-4f19-9912-70ad60d4bf80 with status ACTIVE [ 748.296197] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.296197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.296197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.296197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.296197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.296495] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.296568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.296631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.296872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.297690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.297690] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.297690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.297690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.297690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.298182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.298182] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33d8ed3b-6946-4f19-9912-70ad60d4bf80 is going to be updated. [ 748.322268] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.322457] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.322505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.322727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.322968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.323197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33d8ed3b-6946-4f19-9912-70ad60d4bf80" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.562675] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.562675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.562675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.563067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.563067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.563147] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.563207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.563247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.563432] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.563531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.563620] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 is going to be updated. [ 748.599817] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.600254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.600254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.600653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.600848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.613130] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: IN_PROGRESS for 2s [ 748.700903] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.065343] env[65553]: INFO networking_nsxv3.common.synchronization [req-bc2c27f4-1c86-4d89-8e51-58647d5e2c0c req-a381e95a-5334-40d3-9c5a-12b70eb8f27a tempest-VolumesAssistedSnapshotsTest-1096100020 tempest-VolumesAssistedSnapshotsTest-1096100020-project-member] Enqueued Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_members [ 749.065720] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 with Priority: HIGHEST for action security_group_members [ 749.069488] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec66a418-d823-4b2f-87e2-c61e09ea9de4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.069689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.069770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.069992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.070211] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.070331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.070386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.073900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.073900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.073900] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec66a418-d823-4b2f-87e2-c61e09ea9de4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.202678] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.576580] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.576750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.576833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.577119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.577240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.577451] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.577547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.577621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.577845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.577944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.578045] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 is going to be updated. [ 749.605679] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.605849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.605849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.606081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.606211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.615604] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 in Status: IN_PROGRESS for 2s [ 749.706841] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.707100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.707178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.707460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.707636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.707772] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 749.743494] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.743734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.743808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.744111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.744292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.757319] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 750.624293] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: SUCCESS [ 750.624607] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 deletion is rescheduled due to dependency. [ 750.624607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.158077] env[65553]: INFO networking_nsxv3.common.synchronization [req-270d70d8-0c54-4007-8088-233d801b1458 req-7f35eda4-f3d1-493f-8a27-f5b23bd5c04f tempest-ListServersNegativeTestJSON-1035197214 tempest-ListServersNegativeTestJSON-1035197214-project-member] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 751.158682] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 751.159025] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.159194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.159279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.159506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.159659] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.159807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.159892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.160154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.160291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.160412] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.629020] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 in Status: SUCCESS [ 751.629020] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec66a418-d823-4b2f-87e2-c61e09ea9de4 deletion is rescheduled due to dependency. [ 751.629020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec66a418-d823-4b2f-87e2-c61e09ea9de4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.665281] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.703557] env[65553]: INFO networking_nsxv3.common.synchronization [req-66aafb89-2853-4bce-a9b0-2169f620617a req-c014f910-786d-4a2a-a78c-61d480d7636a tempest-ListServersNegativeTestJSON-1035197214 tempest-ListServersNegativeTestJSON-1035197214-project-member] Enqueued Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 751.704088] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be with Priority: HIGHEST for action security_group_members [ 751.704426] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebd49ee0-d72a-443f-a112-9fa0a970c7be taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.704494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.768092] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 751.768317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.768503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.768946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.768946] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.769090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.769090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.769223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.769301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.769380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.769465] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.170579] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.271921] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.272166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.272258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.272573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.272883] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.272976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.273045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.273548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.273548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.273548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.273758] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.273846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.273945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.274163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.274327] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.274430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.274530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.274706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.274788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.274941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.275289] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.672787] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.673221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.673221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.673476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.673611] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.673919] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be updated. [ 752.703790] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.704010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.704132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.704434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.704655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.715707] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 2s [ 752.779475] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15032a54-f6e7-41b8-855b-0262e8fb39c5: rpc.has_security_group_logging(os_id): False [ 752.798876] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.799047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.799106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.799343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.799423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.799646] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.799747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.799808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.799955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.800049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.800222] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.800318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.800392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.800534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.800607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.800781] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.800872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.800925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.801649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.801649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.801901] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 752.881520] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.881745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.881806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.882017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.882171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.897887] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 753.167024] env[65553]: INFO networking_nsxv3.common.synchronization [req-8a541515-e675-4353-b6df-4fd41cc443c8 req-7f0b900a-d8a7-4074-8ae5-12a736d95377 tempest-ServersTestBootFromVolume-1810122885 tempest-ServersTestBootFromVolume-1810122885-project-member] Enqueued Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_members [ 753.167024] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGHEST for action security_group_members [ 753.167024] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a425597-2f3a-4763-9abe-b15432eceec7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.167024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.167024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.167024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.167024] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.167024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.167024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.167024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.167024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.167024] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.670551] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.670733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.670810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.671053] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.671167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.671697] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.671885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.671953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.672162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.672251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.672347] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a425597-2f3a-4763-9abe-b15432eceec7 is going to be updated. [ 753.703165] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.703548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.703548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.703654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.703829] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.715186] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a425597-2f3a-4763-9abe-b15432eceec7 in Status: IN_PROGRESS for 2s [ 754.727781] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 754.728181] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.728257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.728467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.728703] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.728869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.728938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.729219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.729338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.729451] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebd49ee0-d72a-443f-a112-9fa0a970c7be',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.915027] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 754.915521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.998610] env[65553]: INFO networking_nsxv3.common.synchronization [req-5b4ee325-6a04-4921-81b8-0552cde26981 req-6dfbac4b-a199-44ae-bf86-a4f2dde9cf68 tempest-ListImageFiltersTestJSON-1822898395 tempest-ListImageFiltersTestJSON-1822898395-project-member] Enqueued Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 754.999342] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 754.999696] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.999854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.999949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.000382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.000568] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.000659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.000732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.000933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.001076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.001302] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.234246] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.234508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.234585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.234816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.234903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.235615] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.235759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.235879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.236127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.236220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.236333] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be is going to be updated. [ 755.272788] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.272939] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.273023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.273300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.273476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.283577] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: IN_PROGRESS for 2s [ 755.371879] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.372498] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.372498] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.372498] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.372754] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.373233] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.373233] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.373416] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.373488] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.375359] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.375359] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.375359] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.375359] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.375359] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.375359] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.375359] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.396053] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.396053] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.396053] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.396053] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.396053] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-a46e9795-681e-4165-9082-64efabed67f2 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.396053] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-a46e9795-681e-4165-9082-64efabed67f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.396053] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-a46e9795-681e-4165-9082-64efabed67f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.396053] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-a46e9795-681e-4165-9082-64efabed67f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.396053] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a46e9795-681e-4165-9082-64efabed67f2',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.503817] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.505021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.505021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.505021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.505021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.505021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.505269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.505269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.505389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.505430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.505514] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 already deleted. [ 755.505595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.726153] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a425597-2f3a-4763-9abe-b15432eceec7 in Status: SUCCESS [ 755.726347] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a425597-2f3a-4763-9abe-b15432eceec7 deletion is rescheduled due to dependency. [ 755.726445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.899169] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.899566] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.899710] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.899990] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.900156] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.900311] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port a46e9795-681e-4165-9082-64efabed67f2 not found, creating... [ 755.900579] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.900733] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.900844] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.901076] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.901210] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.901493] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.901723] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.901852] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.902061] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.902192] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.902342] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: a46e9795-681e-4165-9082-64efabed67f2 is going to be created. [ 755.923143] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.923372] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.923472] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.923734] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.923954] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.924171] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-a46e9795-681e-4165-9082-64efabed67f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.533625] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f442a4ff-7f23-4f06-99c5-c7ccd8e423df None None] Enqueued Resource ID: afa65e32-8a8f-4306-b72c-7b7048389110 with Priority: HIGHEST for action port [ 756.534490] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afa65e32-8a8f-4306-b72c-7b7048389110 with Priority: HIGHEST for action port [ 756.535141] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-afa65e32-8a8f-4306-b72c-7b7048389110 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.535141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afa65e32-8a8f-4306-b72c-7b7048389110" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.535141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afa65e32-8a8f-4306-b72c-7b7048389110" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.535544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afa65e32-8a8f-4306-b72c-7b7048389110" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.535544] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afa65e32-8a8f-4306-b72c-7b7048389110',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.657314] env[65553]: INFO networking_nsxv3.common.synchronization [req-5b4ee325-6a04-4921-81b8-0552cde26981 req-d2d73762-fe39-4340-a1bd-71f5702c093d service nova] Enqueued Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_rules [ 756.657717] env[65553]: INFO networking_nsxv3.common.synchronization [req-5b4ee325-6a04-4921-81b8-0552cde26981 req-d2d73762-fe39-4340-a1bd-71f5702c093d service nova] Enqueued Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 756.658795] env[65553]: INFO networking_nsxv3.common.synchronization [req-5b4ee325-6a04-4921-81b8-0552cde26981 req-d2d73762-fe39-4340-a1bd-71f5702c093d service nova] Enqueued Resource ID: a46e9795-681e-4165-9082-64efabed67f2 with Priority: HIGHEST for action port [ 756.658795] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_rules [ 756.658911] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 756.658972] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a46e9795-681e-4165-9082-64efabed67f2 with Priority: HIGHEST for action port [ 756.659420] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.660044] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.660044] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.660044] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.660227] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.661463] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.661525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.661570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.661805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.662010] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.662145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.662254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.662445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.666018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.666018] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.666018] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-a46e9795-681e-4165-9082-64efabed67f2 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.666018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a46e9795-681e-4165-9082-64efabed67f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.666018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a46e9795-681e-4165-9082-64efabed67f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.666018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a46e9795-681e-4165-9082-64efabed67f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.666018] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a46e9795-681e-4165-9082-64efabed67f2',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.878101] env[65553]: INFO networking_nsxv3.common.synchronization [req-a9d1138a-7483-48c7-a904-a77623f27e81 req-7b16f159-e7f4-4f2a-896d-26a0a6546083 tempest-ServersAdminNegativeTestJSON-2073833851 tempest-ServersAdminNegativeTestJSON-2073833851-project-member] Enqueued Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 756.878653] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 756.878982] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.879453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.879537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.879740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.879901] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.880024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.880098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.880485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.880604] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.880725] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.039304] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afa65e32-8a8f-4306-b72c-7b7048389110 [ 757.039304] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.039304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.039304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.039304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.039304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.039304] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afa65e32-8a8f-4306-b72c-7b7048389110 already deleted. [ 757.039304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afa65e32-8a8f-4306-b72c-7b7048389110" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.167067] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.167318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.167800] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.168651] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a46e9795-681e-4165-9082-64efabed67f2 with status ACTIVE [ 757.169704] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.169704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.169704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.169704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.169704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.169704] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.169704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.169704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.170129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.170129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.170129] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.170129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.170256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.170533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.170533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.170533] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a46e9795-681e-4165-9082-64efabed67f2 is going to be updated. [ 757.194164] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.194304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.194375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.194590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.194723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.194888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a46e9795-681e-4165-9082-64efabed67f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.303685] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be in Status: SUCCESS [ 757.303912] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebd49ee0-d72a-443f-a112-9fa0a970c7be deletion is rescheduled due to dependency. [ 757.304103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebd49ee0-d72a-443f-a112-9fa0a970c7be" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.383443] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.672834] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.892037] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.176921] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.177321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.177321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.177396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.178048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.178048] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 is going to be created. [ 758.203211] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.205130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.205130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.205130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.205130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.216992] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: UNINITIALIZED for 2s [ 758.396445] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.396445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.396445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.396445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.396445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.396445] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 is going to be updated. [ 758.428423] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.428600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.428649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.428864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.429029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.438678] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: IN_PROGRESS for 2s [ 758.525945] env[65553]: INFO networking_nsxv3.common.synchronization [None req-fa3bceb7-6546-46ff-87be-819b7b4b7554 None None] Enqueued Resource ID: 31d2f5a1-ca7e-48f4-a5a3-e50f176e61c1 with Priority: HIGHEST for action port [ 758.525945] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d2f5a1-ca7e-48f4-a5a3-e50f176e61c1 with Priority: HIGHEST for action port [ 758.525945] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-31d2f5a1-ca7e-48f4-a5a3-e50f176e61c1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.525945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31d2f5a1-ca7e-48f4-a5a3-e50f176e61c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.525945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31d2f5a1-ca7e-48f4-a5a3-e50f176e61c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.525945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31d2f5a1-ca7e-48f4-a5a3-e50f176e61c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.525945] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d2f5a1-ca7e-48f4-a5a3-e50f176e61c1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.029892] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31d2f5a1-ca7e-48f4-a5a3-e50f176e61c1 [ 759.029892] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.029892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.029892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.029892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.030264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.030264] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31d2f5a1-ca7e-48f4-a5a3-e50f176e61c1 already deleted. [ 759.030264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31d2f5a1-ca7e-48f4-a5a3-e50f176e61c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.228601] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: UNINITIALIZED for 4s [ 760.450140] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: SUCCESS [ 760.450362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.935924] env[65553]: INFO networking_nsxv3.common.synchronization [req-241796d9-1c16-41ed-9cc5-dac4bac2dc7e req-992a208b-b923-40ee-afd5-2c3b62d88975 tempest-ListImageFiltersTestJSON-1822898395 tempest-ListImageFiltersTestJSON-1822898395-project-member] Enqueued Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 760.936517] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 760.936834] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.936945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.237645] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.238635] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.239082] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.239487] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.240027] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.242886] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.242886] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.242886] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.242886] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.242886] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.242886] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.242886] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.242886] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.242886] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.242886] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.242886] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.263434] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.264106] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.264365] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.264561] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.264868] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-283a446b-da71-4d08-b70a-6d0468dabf79 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.265050] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-283a446b-da71-4d08-b70a-6d0468dabf79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.265208] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-283a446b-da71-4d08-b70a-6d0468dabf79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.265526] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-283a446b-da71-4d08-b70a-6d0468dabf79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.265661] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('283a446b-da71-4d08-b70a-6d0468dabf79',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.768293] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.768565] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.768721] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.769116] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.769387] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.769582] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 283a446b-da71-4d08-b70a-6d0468dabf79 not found, creating... [ 761.769876] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.770086] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.770351] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.770608] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.770925] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.771251] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.771465] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.771614] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.772460] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.772460] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.772460] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 283a446b-da71-4d08-b70a-6d0468dabf79 is going to be created. [ 761.794934] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.795303] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.795389] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.795627] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.795826] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.796054] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-283a446b-da71-4d08-b70a-6d0468dabf79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.240449] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: SUCCESS [ 762.240449] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.241071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.241071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.241071] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.241313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.241313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.241404] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.241459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.241555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.241661] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.242872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.243101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.243282] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.243411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.243464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.243641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.243686] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.243780] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.570324] env[65553]: INFO networking_nsxv3.common.synchronization [req-241796d9-1c16-41ed-9cc5-dac4bac2dc7e req-d67aece1-9ee4-4149-a3ac-aa23204a2e71 service nova] Enqueued Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_rules [ 762.570539] env[65553]: INFO networking_nsxv3.common.synchronization [req-241796d9-1c16-41ed-9cc5-dac4bac2dc7e req-d67aece1-9ee4-4149-a3ac-aa23204a2e71 service nova] Enqueued Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 762.570597] env[65553]: INFO networking_nsxv3.common.synchronization [req-241796d9-1c16-41ed-9cc5-dac4bac2dc7e req-d67aece1-9ee4-4149-a3ac-aa23204a2e71 service nova] Enqueued Resource ID: 283a446b-da71-4d08-b70a-6d0468dabf79 with Priority: HIGHEST for action port [ 762.571200] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_rules [ 762.571338] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 762.571437] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283a446b-da71-4d08-b70a-6d0468dabf79 with Priority: HIGHEST for action port [ 762.571713] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.571813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.572277] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.572277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.572482] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-283a446b-da71-4d08-b70a-6d0468dabf79 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.572589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-283a446b-da71-4d08-b70a-6d0468dabf79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.572652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-283a446b-da71-4d08-b70a-6d0468dabf79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.572854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-283a446b-da71-4d08-b70a-6d0468dabf79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.572934] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('283a446b-da71-4d08-b70a-6d0468dabf79',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.745500] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.745619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.745875] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.076493] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 283a446b-da71-4d08-b70a-6d0468dabf79 with status ACTIVE [ 763.076727] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.076861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.076940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.077189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.077293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.077479] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.077575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.077632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.077777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.077848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.078051] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.078138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.078195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.078368] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.078462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.078553] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 283a446b-da71-4d08-b70a-6d0468dabf79 is going to be updated. [ 763.102869] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.102983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.102983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.103205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.103342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.103569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-283a446b-da71-4d08-b70a-6d0468dabf79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.249062] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.751092] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.751247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.751309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.751576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.751970] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.752150] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 is going to be updated. [ 763.809483] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.809717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.809791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.810182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.810350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.822506] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: IN_PROGRESS for 2s [ 765.834487] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: SUCCESS [ 765.834783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.834971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.835344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.835864] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.835864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.835864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.835864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.836060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.836060] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.876802] env[65553]: INFO networking_nsxv3.common.synchronization [req-428b44c8-911c-42e8-8712-324c9411143d req-129fbead-d3a1-477d-98a0-055aff5b7cac tempest-ServersAdminTestJSON-844759989 tempest-ServersAdminTestJSON-844759989-project-member] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 765.877440] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 765.877766] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.877895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.877978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.878680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.879030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.879030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.879222] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.879388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.879538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.879608] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.261190] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.261190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.261190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.261190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.261190] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.261190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.261190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.261190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.261190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.261190] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.261190] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.261190] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.261896] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.261896] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.261896] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.261896] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.280855] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.281115] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.281568] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.281568] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.281684] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-a614a7b1-8513-48e5-bb7b-22d9e92f755c taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.281779] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-a614a7b1-8513-48e5-bb7b-22d9e92f755c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.281885] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-a614a7b1-8513-48e5-bb7b-22d9e92f755c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.282236] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-a614a7b1-8513-48e5-bb7b-22d9e92f755c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.282373] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a614a7b1-8513-48e5-bb7b-22d9e92f755c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.341114] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.381965] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.382318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.382418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.382702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.383536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.383836] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.383977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.384063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.384284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.384376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.384526] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 already deleted. [ 766.384612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.715175] env[65553]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] NSXv3 Agent Agent loop - iteration:0 completed [ 766.716156] env[65553]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] NSXv3 Agent Agent loop - iteration:1 started [ 766.784616] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.785680] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.785680] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.785680] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.785680] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.785680] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port a614a7b1-8513-48e5-bb7b-22d9e92f755c not found, creating... [ 766.785902] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.786025] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.786141] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.786416] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.786605] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.786963] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.787084] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.787211] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.787368] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.787501] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.787635] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: a614a7b1-8513-48e5-bb7b-22d9e92f755c is going to be created. [ 766.813197] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.813197] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.813507] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.813843] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.814111] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.814333] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-a614a7b1-8513-48e5-bb7b-22d9e92f755c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.843642] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.111121] env[65553]: INFO networking_nsxv3.common.synchronization [None req-cbb03267-e561-4a2b-97a5-c250056d61ba None None] Enqueued Resource ID: d2b58440-7f74-4d77-b80c-afde435fa03a with Priority: HIGHEST for action port [ 767.111581] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b58440-7f74-4d77-b80c-afde435fa03a with Priority: HIGHEST for action port [ 767.111882] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2b58440-7f74-4d77-b80c-afde435fa03a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.112015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2b58440-7f74-4d77-b80c-afde435fa03a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.112071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2b58440-7f74-4d77-b80c-afde435fa03a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.112373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2b58440-7f74-4d77-b80c-afde435fa03a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.112421] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2b58440-7f74-4d77-b80c-afde435fa03a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.348904] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.348904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.348904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.348904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.348904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.348904] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 is going to be updated. [ 767.380026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.380026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.380026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.380026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.380026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.394429] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: IN_PROGRESS for 2s [ 767.576799] env[65553]: INFO networking_nsxv3.common.synchronization [req-428b44c8-911c-42e8-8712-324c9411143d req-9bfc6b5b-7be6-425a-8687-0f601ccbae5b service nova] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_rules [ 767.576799] env[65553]: INFO networking_nsxv3.common.synchronization [req-428b44c8-911c-42e8-8712-324c9411143d req-9bfc6b5b-7be6-425a-8687-0f601ccbae5b service nova] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 767.576799] env[65553]: INFO networking_nsxv3.common.synchronization [req-428b44c8-911c-42e8-8712-324c9411143d req-9bfc6b5b-7be6-425a-8687-0f601ccbae5b service nova] Enqueued Resource ID: a614a7b1-8513-48e5-bb7b-22d9e92f755c with Priority: HIGHEST for action port [ 767.577133] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_rules [ 767.577282] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 767.577528] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a614a7b1-8513-48e5-bb7b-22d9e92f755c with Priority: HIGHEST for action port [ 767.577777] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.577995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.577995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.578234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.578376] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.579221] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.579386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.579666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.579666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.579732] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.579851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.579851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.582017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.582017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.582017] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.582017] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-a614a7b1-8513-48e5-bb7b-22d9e92f755c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.582017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a614a7b1-8513-48e5-bb7b-22d9e92f755c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.582017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a614a7b1-8513-48e5-bb7b-22d9e92f755c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.582017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a614a7b1-8513-48e5-bb7b-22d9e92f755c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.582017] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a614a7b1-8513-48e5-bb7b-22d9e92f755c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.614666] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2b58440-7f74-4d77-b80c-afde435fa03a [ 767.614880] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.615056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.615131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.615373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.615472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.615570] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2b58440-7f74-4d77-b80c-afde435fa03a already deleted. [ 767.615673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2b58440-7f74-4d77-b80c-afde435fa03a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.079402] env[65553]: INFO networking_nsxv3.common.synchronization [req-7db3d65b-5f44-4b67-8d72-fca77ac4e75b req-46dcb6aa-6416-4fda-b315-3b73f3bd46da tempest-ImagesOneServerNegativeTestJSON-967710394 tempest-ImagesOneServerNegativeTestJSON-967710394-project-member] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 768.080013] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 768.080350] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.082023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.082023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.082023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.082023] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.082324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.082422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.082627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.082766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.082899] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.084377] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.084499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.085436] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.085909] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a614a7b1-8513-48e5-bb7b-22d9e92f755c with status ACTIVE [ 768.086192] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.086947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.086947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.086947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.087622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.089033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.089033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.089033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.089033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.089224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.089277] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.089435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.089484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.089694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.089785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.090270] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a614a7b1-8513-48e5-bb7b-22d9e92f755c is going to be updated. [ 768.119317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.119463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.119534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.119742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.119897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.120100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a614a7b1-8513-48e5-bb7b-22d9e92f755c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.450503] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-236 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.450503] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.450503] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.450503] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.450775] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.451031] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.451031] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.451184] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.451322] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.451525] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.451625] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.451723] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.451821] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.451916] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.452021] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.452145] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.472404] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.472521] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.472964] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.472964] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.473208] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-99b817d3-2f6b-4daa-a161-302111a9b693 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.473383] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-99b817d3-2f6b-4daa-a161-302111a9b693" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.473496] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-99b817d3-2f6b-4daa-a161-302111a9b693" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.473815] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-99b817d3-2f6b-4daa-a161-302111a9b693" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.473984] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99b817d3-2f6b-4daa-a161-302111a9b693',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.587614] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.587737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.587774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.589650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.589650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.589650] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.589650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.589650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.589650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.589650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.589650] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 already deleted. [ 768.589650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.593753] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.978208] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.981194] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.981194] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.981194] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.981194] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.981194] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 99b817d3-2f6b-4daa-a161-302111a9b693 not found, creating... [ 768.981194] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.981194] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.981194] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.981194] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.981194] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.981511] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.981511] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.981511] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.981921] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.982170] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.982406] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 99b817d3-2f6b-4daa-a161-302111a9b693 is going to be created. [ 769.005693] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.005693] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.005693] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.005693] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.006433] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.006845] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-99b817d3-2f6b-4daa-a161-302111a9b693" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.094943] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.095360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.095360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.095500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.095589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.095704] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be created. [ 769.127166] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.127289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.127289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.127468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.127649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.139657] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: UNINITIALIZED for 2s [ 769.410384] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: SUCCESS [ 769.410616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.410816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.411057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.411295] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.411416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.411499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.411661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.411749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.411840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.412036] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.412145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.412212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.412356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.412517] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.412613] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.412714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.412814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.412892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.412970] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.416265] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.445025] env[65553]: INFO networking_nsxv3.common.synchronization [None req-672eedaa-ec67-4915-a2bf-4aa1ce573581 None None] Enqueued Resource ID: 33d3c0fc-0383-45a4-a135-ee31d4758e75 with Priority: HIGHEST for action port [ 769.445784] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33d3c0fc-0383-45a4-a135-ee31d4758e75 with Priority: HIGHEST for action port [ 769.446819] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-33d3c0fc-0383-45a4-a135-ee31d4758e75 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.447135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33d3c0fc-0383-45a4-a135-ee31d4758e75" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.447252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33d3c0fc-0383-45a4-a135-ee31d4758e75" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.448818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33d3c0fc-0383-45a4-a135-ee31d4758e75" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.448818] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33d3c0fc-0383-45a4-a135-ee31d4758e75',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.798037] env[65553]: INFO networking_nsxv3.common.synchronization [req-7db3d65b-5f44-4b67-8d72-fca77ac4e75b req-bd3a0004-e915-40c7-8d54-308267ca774c service nova] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_rules [ 769.798037] env[65553]: INFO networking_nsxv3.common.synchronization [req-7db3d65b-5f44-4b67-8d72-fca77ac4e75b req-bd3a0004-e915-40c7-8d54-308267ca774c service nova] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 769.798037] env[65553]: INFO networking_nsxv3.common.synchronization [req-7db3d65b-5f44-4b67-8d72-fca77ac4e75b req-bd3a0004-e915-40c7-8d54-308267ca774c service nova] Enqueued Resource ID: 99b817d3-2f6b-4daa-a161-302111a9b693 with Priority: HIGHEST for action port [ 769.798216] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_rules [ 769.798361] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 769.798514] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b817d3-2f6b-4daa-a161-302111a9b693 with Priority: HIGHEST for action port [ 769.798728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.798847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.798910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.799929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.799929] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.801592] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.801819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.801819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.801959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.802166] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.802259] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.802313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.802429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.803757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.803864] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.805728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-99b817d3-2f6b-4daa-a161-302111a9b693 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.806101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99b817d3-2f6b-4daa-a161-302111a9b693" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.806101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99b817d3-2f6b-4daa-a161-302111a9b693" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.806214] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99b817d3-2f6b-4daa-a161-302111a9b693" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.806214] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99b817d3-2f6b-4daa-a161-302111a9b693',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.925413] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7ba6400-0dc9-4a80-ad83-aeeb3037ae85: rpc.has_security_group_logging(os_id): False [ 769.947056] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.947214] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.947286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.947509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.947630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.947846] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.947950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.948027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.948192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.948273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.948502] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.948569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.948631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.948773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.948845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.949077] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.949189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.949251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.949408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.949482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.949567] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 is going to be created. [ 769.952250] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33d3c0fc-0383-45a4-a135-ee31d4758e75 [ 769.952421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.952525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.952591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.952747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.952827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.952945] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33d3c0fc-0383-45a4-a135-ee31d4758e75 already deleted. [ 769.952974] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33d3c0fc-0383-45a4-a135-ee31d4758e75" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.012584] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.012812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.013072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.013456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.013606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.025314] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: IN_PROGRESS for 2s [ 770.306281] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.307920] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.308050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.308229] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99b817d3-2f6b-4daa-a161-302111a9b693 with status ACTIVE [ 770.308395] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.308501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.308566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.308774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.308858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.309048] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.309148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.309206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.309362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.309491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.309728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.309728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.309851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.309915] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.310022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.310087] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99b817d3-2f6b-4daa-a161-302111a9b693 is going to be updated. [ 770.346589] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.346713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.346839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.346993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.347154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.347320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99b817d3-2f6b-4daa-a161-302111a9b693" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.808864] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.863598] env[65553]: INFO networking_nsxv3.common.synchronization [req-4d595a20-c53b-42be-8fcb-e4b483e49aa4 req-1a0802ee-8ea5-48ff-906a-9d621fdda227 tempest-ServersAdminTestJSON-844759989 tempest-ServersAdminTestJSON-844759989-project-member] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 770.864366] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 770.864366] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.864518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.152111] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 771.152336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.152506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.152728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.152919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.153072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.153142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.153412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.153509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.153549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.153653] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.154632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.155043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.157631] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.157631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.157631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.157631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.157631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.157631] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.185891] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.186520] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.186790] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.187206] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.187631] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.187907] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.188104] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.188439] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.188642] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.188933] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.189128] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.189259] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.189422] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.189577] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.189751] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.190390] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.212254] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.212377] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 771.212470] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.212638] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.212985] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-9765ffdc-13a7-4732-96a8-aaa70a394eb8 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.213264] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-9765ffdc-13a7-4732-96a8-aaa70a394eb8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.213394] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-9765ffdc-13a7-4732-96a8-aaa70a394eb8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.213714] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-9765ffdc-13a7-4732-96a8-aaa70a394eb8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.213852] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9765ffdc-13a7-4732-96a8-aaa70a394eb8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.311170] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.311588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.311588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.312513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.312785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.312785] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be created. [ 771.347626] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.347789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.347871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.348123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.348311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.361399] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: UNINITIALIZED for 2s [ 771.657983] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.658146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.661524] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.716756] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.717019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.717177] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.717500] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.717673] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.717820] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 9765ffdc-13a7-4732-96a8-aaa70a394eb8 not found, creating... [ 771.718091] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.718245] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.718359] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.718568] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.718699] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.718966] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.719124] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.719235] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.719434] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.719562] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.719694] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 9765ffdc-13a7-4732-96a8-aaa70a394eb8 is going to be created. [ 771.749427] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.749427] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.749427] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.749427] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.749427] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.749427] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-9765ffdc-13a7-4732-96a8-aaa70a394eb8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.045967] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: SUCCESS [ 772.046351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.046678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.047072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.047226] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.163802] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.501356] env[65553]: INFO networking_nsxv3.common.synchronization [req-4d595a20-c53b-42be-8fcb-e4b483e49aa4 req-be8d2b2f-97f9-4715-9d51-2ea068d7374d service nova] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_rules [ 772.501621] env[65553]: INFO networking_nsxv3.common.synchronization [req-4d595a20-c53b-42be-8fcb-e4b483e49aa4 req-be8d2b2f-97f9-4715-9d51-2ea068d7374d service nova] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 772.501866] env[65553]: INFO networking_nsxv3.common.synchronization [req-4d595a20-c53b-42be-8fcb-e4b483e49aa4 req-be8d2b2f-97f9-4715-9d51-2ea068d7374d service nova] Enqueued Resource ID: 9765ffdc-13a7-4732-96a8-aaa70a394eb8 with Priority: HIGHEST for action port [ 772.502527] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_rules [ 772.502869] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 772.502869] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9765ffdc-13a7-4732-96a8-aaa70a394eb8 with Priority: HIGHEST for action port [ 772.503274] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.503408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.503671] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.503820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.504119] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9765ffdc-13a7-4732-96a8-aaa70a394eb8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.504246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9765ffdc-13a7-4732-96a8-aaa70a394eb8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.504340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9765ffdc-13a7-4732-96a8-aaa70a394eb8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.504616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9765ffdc-13a7-4732-96a8-aaa70a394eb8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.504741] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9765ffdc-13a7-4732-96a8-aaa70a394eb8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.550292] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.550472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.550630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.550965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.551186] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.551323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.551413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.551608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.551692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.551801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.551936] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.667126] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.667298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.667364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.667599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.667701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.667819] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 772.739564] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.739717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.739781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.740013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.741037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.748982] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 773.012198] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9765ffdc-13a7-4732-96a8-aaa70a394eb8 with status ACTIVE [ 773.012198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.012198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.012198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.012198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.012198] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9765ffdc-13a7-4732-96a8-aaa70a394eb8 is going to be updated. [ 773.034546] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.035219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.035219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.035219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.036567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.036567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9765ffdc-13a7-4732-96a8-aaa70a394eb8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.055231] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.055391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.055490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.055708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.055886] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.055989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.056065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.056233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.056345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.056444] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.056597] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.056688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.056747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.056937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.057141] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.057238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.057306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.057477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.057555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.057637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.057725] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.372201] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: SUCCESS [ 773.372543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.372758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.373063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.373360] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.373492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.373562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.373710] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.373928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.373928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.373997] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.560427] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7ba6400-0dc9-4a80-ad83-aeeb3037ae85: rpc.has_security_group_logging(os_id): False [ 773.577342] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.577502] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.577606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.577848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.577992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.578148] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.578250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.578314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.578473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.578549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.578756] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.578850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.578944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.579063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.579138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.579361] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.579478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.579577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.579730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.579844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.579941] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 is going to be updated. [ 773.642020] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.642020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.642020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.642020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.642020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.656013] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: IN_PROGRESS for 2s [ 773.877284] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.877284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.877284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.877284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.877284] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.877284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.877284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.877284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.877284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.877845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.877845] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.877845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.877845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.878040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.878079] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.878196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.878402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.878603] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.878722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.878854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.879012] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.381450] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d069dc70-d382-4790-b884-3c9bf5e88eb0: rpc.has_security_group_logging(os_id): False [ 774.409494] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.409494] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.409494] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.409494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.410139] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.410801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.410801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.410801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.410801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.410801] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be created. [ 774.513363] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.513572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.513630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.514328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.514328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.529571] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: IN_PROGRESS for 2s [ 774.762283] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 774.762679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.762679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.762895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.763111] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.763286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.763286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.763452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.763535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.763620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.763791] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.763886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.763944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.764112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.764334] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.764492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.764556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.764726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.764808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.764871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.764939] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.765973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.766227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.766481] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.766912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.766912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.768088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.768088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.768088] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.270074] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c96c798-8819-41b0-9168-410c415c2391: rpc.has_security_group_logging(os_id): False [ 775.270997] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.291492] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.291659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.291659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.292226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.292226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.292226] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.292389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.292389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.292501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.292573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.292752] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.292836] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.293429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.293429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.293429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.293429] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.293429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.293429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.293682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.293682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.293746] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be created. [ 775.357082] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.357082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.357325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.357477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.357658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.371680] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 775.671859] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: SUCCESS [ 775.671859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.777180] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.280756] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.281210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.281379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.281696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.281835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.281953] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 776.326758] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.326758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.326758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.326969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.327132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.340560] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 776.545199] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: SUCCESS [ 776.545478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.386019] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 777.386323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.386685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.386758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.386806] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.503992] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 777.504164] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 777.891372] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.891685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.354981] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 778.355359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.355548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.355833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.356087] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.356225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.356417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.356491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.356532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.356637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.356727] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.596583] env[65553]: INFO networking_nsxv3.common.synchronization [req-338912b5-6ad2-4855-8818-43d68b211316 req-8ee3ca5a-f72a-4f17-90ef-955df58b636b tempest-ListServerFiltersTestJSON-2035845723 tempest-ListServerFiltersTestJSON-2035845723-project-member] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 778.597337] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 778.597693] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.597823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.597887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.601190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.601190] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.601190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.601190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.601190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.601190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.601190] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.862047] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.862047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.862047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.862327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.862488] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.862622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.862712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.862952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.863094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.863227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.863389] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.863487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.863549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.863697] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.863839] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.864035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.864109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.864255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.864335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.864418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.864506] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.107308] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.370544] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c96c798-8819-41b0-9168-410c415c2391: rpc.has_security_group_logging(os_id): False [ 779.396627] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.396627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.396627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.396627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.396627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.396627] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.396627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.396627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.396627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.396627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.408050] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.408050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.408050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.408050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.408050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.408050] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.408050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.408050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.408050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.408050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.408050] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 779.519722] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.519722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.519722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.519722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.519722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.536877] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 779.611367] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.114581] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.114581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.114860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.114971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.115181] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.117533] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be updated. [ 780.150721] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.150721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.150721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.150721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.150721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.160811] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: IN_PROGRESS for 2s [ 781.554657] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 781.555045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.172368] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 782.172629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.598838] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 783.599110] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 786.048493] env[65553]: INFO networking_nsxv3.common.synchronization [req-8df1cf62-a4ff-4838-b7ca-9deea5ee904d req-b4a04197-59c3-4188-9e3c-35eca42aab1e tempest-ServersTestFqdnHostnames-1268563277 tempest-ServersTestFqdnHostnames-1268563277-project-member] Enqueued Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_members [ 786.050397] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGHEST for action security_group_members [ 786.050397] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.050397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.050397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.050993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.051209] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.051344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.051407] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.052364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.052464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.052570] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.557550] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.557771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.557860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.558124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.558234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.558541] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.558661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.558724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.558910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.559095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.559216] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd is going to be updated. [ 786.592332] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.592332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.592332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.592332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.592332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.601722] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd in Status: IN_PROGRESS for 2s [ 788.078096] env[65553]: INFO networking_nsxv3.common.synchronization [req-a4633b75-c61c-4b72-9d46-ee80d92fc2d5 req-2f3d3dc5-1ea0-4fe7-85ef-26c9006c802d tempest-FloatingIPsAssociationTestJSON-1444757961 tempest-FloatingIPsAssociationTestJSON-1444757961-project-member] Enqueued Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 788.078865] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGHEST for action security_group_members [ 788.079269] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.079430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.079538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.079856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.079915] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.079989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.080069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.080266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.080401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.080517] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.583035] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.583201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.583201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.583507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.583605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.583896] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.583960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.583997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.584169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.584247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.584332] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfefe395-d857-43f0-952f-7a8984da2f70 is going to be updated. [ 788.615022] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd in Status: SUCCESS [ 788.615279] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd deletion is rescheduled due to dependency. [ 788.615658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.637845] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.637997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.638090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.638311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.638455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.651965] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: IN_PROGRESS for 2s [ 790.102974] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d4cd2f98-9b99-47f4-9f02-2943fdbc6392 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_rules [ 790.102974] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_rules [ 790.103421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-424e0166-59a6-441d-abf8-1fa9f2584819 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.103577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.103784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.104180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.104329] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.191124] env[65553]: INFO networking_nsxv3.common.synchronization [None req-5417fe08-91c3-4e52-be65-17b660d1cf30 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_rules [ 790.191124] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_rules [ 790.191440] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-424e0166-59a6-441d-abf8-1fa9f2584819 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.191544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.626607] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.626607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.626607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.626607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.626607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.626607] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 424e0166-59a6-441d-abf8-1fa9f2584819 already deleted. [ 790.626607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.626607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.626607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.626607] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.663963] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfefe395-d857-43f0-952f-7a8984da2f70 in Status: SUCCESS [ 790.664200] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfefe395-d857-43f0-952f-7a8984da2f70 deletion is rescheduled due to dependency. [ 790.664320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.159241] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.159241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.159241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.159581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.159581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.159732] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 424e0166-59a6-441d-abf8-1fa9f2584819 already deleted. [ 791.159732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.273648] env[65553]: INFO networking_nsxv3.common.synchronization [req-136758b8-2776-4370-8810-d708e0932f0a req-6cce79a6-c786-419f-b007-5b1003fc1788 tempest-ServersWithSpecificFlavorTestJSON-819002853 tempest-ServersWithSpecificFlavorTestJSON-819002853-project-member] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 792.274255] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 792.274571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.274690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.274748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.274963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.275296] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.275469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.275547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.275709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.275795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.275907] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.651681] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.651869] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-281" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.651984] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-281" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.652297] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-281" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.652548] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.652701] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.652806] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.653017] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.653158] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.653362] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.653477] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.653588] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.653692] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.653795] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.653898] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.654023] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.673529] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.674513] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 792.674513] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.674513] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-281" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.674513] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-c4b849dd-825e-452f-b2f5-ce31b7640d66 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.674761] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-c4b849dd-825e-452f-b2f5-ce31b7640d66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.674806] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-c4b849dd-825e-452f-b2f5-ce31b7640d66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.675104] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-c4b849dd-825e-452f-b2f5-ce31b7640d66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.675243] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4b849dd-825e-452f-b2f5-ce31b7640d66',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.778714] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.778970] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.779072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.779423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.779423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.779689] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.779797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.779866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.780088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.780258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.780309] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a is going to be updated. [ 792.811884] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.812094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.812173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.812513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.812692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.823524] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: IN_PROGRESS for 2s [ 793.178406] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.178839] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.178839] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.179109] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.179242] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.179399] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port c4b849dd-825e-452f-b2f5-ce31b7640d66 not found, creating... [ 793.179657] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.179805] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.179912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.180147] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.180274] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.180540] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.180686] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.180792] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.180988] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.181125] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.181252] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: c4b849dd-825e-452f-b2f5-ce31b7640d66 is going to be created. [ 793.207705] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.208099] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.208239] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.208521] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.208744] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.209273] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-c4b849dd-825e-452f-b2f5-ce31b7640d66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.923482] env[65553]: INFO networking_nsxv3.common.synchronization [req-136758b8-2776-4370-8810-d708e0932f0a req-e32c7044-f868-4ccb-9d2a-69f188ddd578 service nova] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_rules [ 793.923749] env[65553]: INFO networking_nsxv3.common.synchronization [req-136758b8-2776-4370-8810-d708e0932f0a req-e32c7044-f868-4ccb-9d2a-69f188ddd578 service nova] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 793.923749] env[65553]: INFO networking_nsxv3.common.synchronization [req-136758b8-2776-4370-8810-d708e0932f0a req-e32c7044-f868-4ccb-9d2a-69f188ddd578 service nova] Enqueued Resource ID: c4b849dd-825e-452f-b2f5-ce31b7640d66 with Priority: HIGHEST for action port [ 793.924299] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_rules [ 793.924460] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 793.924533] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4b849dd-825e-452f-b2f5-ce31b7640d66 with Priority: HIGHEST for action port [ 793.924797] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.924922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.925046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.925349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.925483] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.927566] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.927566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.927722] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4b849dd-825e-452f-b2f5-ce31b7640d66 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.927851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4b849dd-825e-452f-b2f5-ce31b7640d66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.927897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4b849dd-825e-452f-b2f5-ce31b7640d66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.928089] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4b849dd-825e-452f-b2f5-ce31b7640d66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.928168] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4b849dd-825e-452f-b2f5-ce31b7640d66',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.428488] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.428488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.436027] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4b849dd-825e-452f-b2f5-ce31b7640d66 with status ACTIVE [ 794.436027] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.436027] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.436027] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.436027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.436027] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4b849dd-825e-452f-b2f5-ce31b7640d66 is going to be updated. [ 794.458428] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.458658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.458799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.459366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.459578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.459826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4b849dd-825e-452f-b2f5-ce31b7640d66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.557685] env[65553]: INFO networking_nsxv3.common.synchronization [req-0a9c634a-4b52-4c28-8873-7c7c6609476a req-a1c7103f-31f5-4d3f-a1d8-92621d5e80c1 tempest-ImagesOneServerNegativeTestJSON-967710394 tempest-ImagesOneServerNegativeTestJSON-967710394-project-member] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 794.558261] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 794.558653] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.558776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.559169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.559361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.559967] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.559967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.559967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.559967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.560200] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.560200] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.792629] env[65553]: INFO networking_nsxv3.common.synchronization [None req-e32ceb84-3a4a-4a48-9746-0ed431144c0c tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_rules [ 794.793260] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_rules [ 794.793612] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76312788-a044-46c4-912d-a43bc9c8e59f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.793771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.794201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.794201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.794201] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76312788-a044-46c4-912d-a43bc9c8e59f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.835223] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: SUCCESS [ 794.835223] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a deletion is rescheduled due to dependency. [ 794.835223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.835223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.835223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.835484] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.835484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.835574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.835770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.835885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.836055] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.880130] env[65553]: INFO networking_nsxv3.common.synchronization [None req-1b20c50c-1c33-4db8-87b1-18490b6553d1 tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_rules [ 794.880130] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_rules [ 794.880130] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76312788-a044-46c4-912d-a43bc9c8e59f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.880531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.065080] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.065080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.065080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.065080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.065080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.065613] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.065613] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.065613] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.065782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.065831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.065946] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be updated. [ 795.110291] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.110291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.110291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.110291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.110291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.130142] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: IN_PROGRESS for 2s [ 795.317105] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.317269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.317337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.317553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.317639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.317737] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76312788-a044-46c4-912d-a43bc9c8e59f already deleted. [ 795.317820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.318112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.318295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.318295] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76312788-a044-46c4-912d-a43bc9c8e59f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.338156] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.840560] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.840823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.840823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.841116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.841231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.841332] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76312788-a044-46c4-912d-a43bc9c8e59f already deleted. [ 795.841425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.843354] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.346221] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.346585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.346585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.346585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.346774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.346774] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a is going to be updated. [ 796.383639] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.383877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.383877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.383989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.384150] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.394689] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: IN_PROGRESS for 2s [ 797.141025] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: SUCCESS [ 797.141233] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 deletion is rescheduled due to dependency. [ 797.141360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.408913] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: SUCCESS [ 798.409234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.409652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.409905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.410122] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.410241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.410309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.410477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.410567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.410771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.410771] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.915060] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.418624] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ed73c0e-357c-432a-a683-eda251f6d85a: rpc.has_security_group_logging(os_id): False [ 799.442903] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.442903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.442903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.442903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.442903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.443291] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.443291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.443291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.443452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.443452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.443532] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a is going to be updated. [ 799.533227] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.533509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.533569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.533843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.534036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.559987] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: IN_PROGRESS for 2s [ 799.880974] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 799.881171] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 801.576585] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: SUCCESS [ 801.576946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.882702] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 804.883045] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 807.956589] env[65553]: INFO networking_nsxv3.common.synchronization [req-b02d863c-834e-4056-91d4-a9e9db996241 req-b5e49433-ea3e-4324-9727-b422163f091b tempest-InstanceActionsV221TestJSON-797501730 tempest-InstanceActionsV221TestJSON-797501730-project-member] Enqueued Resource ID: cda90900-060d-4f5f-a75d-9682dced28fb with Priority: HIGHEST for action security_group_members [ 807.957288] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda90900-060d-4f5f-a75d-9682dced28fb with Priority: HIGHEST for action security_group_members [ 807.957619] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda90900-060d-4f5f-a75d-9682dced28fb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.957756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.957844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.958289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.958524] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.958625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.958625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.958859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.958947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.959090] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cda90900-060d-4f5f-a75d-9682dced28fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.463877] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.464082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.464202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.464495] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.465255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.465255] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.465255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.465255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.465255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.465532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.465532] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda90900-060d-4f5f-a75d-9682dced28fb already deleted. [ 808.465532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.605937] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.606140] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-618" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.606259] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-618" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.606574] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-618" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.606857] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.607023] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.607560] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.607846] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.608077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.608346] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.608504] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.608662] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.608903] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.609074] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.609286] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.609484] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.631357] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.631524] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 808.631656] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.631822] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-618" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.632138] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-22fe3f10-da32-4a3d-99ce-11c807c6b585 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.632310] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-22fe3f10-da32-4a3d-99ce-11c807c6b585" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.632423] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-22fe3f10-da32-4a3d-99ce-11c807c6b585" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.632731] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-22fe3f10-da32-4a3d-99ce-11c807c6b585" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.632864] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22fe3f10-da32-4a3d-99ce-11c807c6b585',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.135258] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.135667] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.135667] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.135903] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.136298] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.136377] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 22fe3f10-da32-4a3d-99ce-11c807c6b585 not found, creating... [ 809.136624] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.136837] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.136901] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.137138] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.137291] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.137564] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.137703] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.137797] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.137997] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.138270] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.138412] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 22fe3f10-da32-4a3d-99ce-11c807c6b585 is going to be created. [ 809.160120] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.160435] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.160566] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.160918] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.161212] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.161514] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-22fe3f10-da32-4a3d-99ce-11c807c6b585" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.884220] env[65553]: INFO networking_nsxv3.common.synchronization [req-b02d863c-834e-4056-91d4-a9e9db996241 req-cb5d37ef-f13a-4cc7-8c33-b515ec82d5f3 service nova] Enqueued Resource ID: cda90900-060d-4f5f-a75d-9682dced28fb with Priority: HIGHEST for action security_group_rules [ 809.884220] env[65553]: INFO networking_nsxv3.common.synchronization [req-b02d863c-834e-4056-91d4-a9e9db996241 req-cb5d37ef-f13a-4cc7-8c33-b515ec82d5f3 service nova] Enqueued Resource ID: cda90900-060d-4f5f-a75d-9682dced28fb with Priority: HIGHEST for action security_group_members [ 809.884220] env[65553]: INFO networking_nsxv3.common.synchronization [req-b02d863c-834e-4056-91d4-a9e9db996241 req-cb5d37ef-f13a-4cc7-8c33-b515ec82d5f3 service nova] Enqueued Resource ID: 22fe3f10-da32-4a3d-99ce-11c807c6b585 with Priority: HIGHEST for action port [ 809.884220] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda90900-060d-4f5f-a75d-9682dced28fb with Priority: HIGHEST for action security_group_rules [ 809.884220] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda90900-060d-4f5f-a75d-9682dced28fb with Priority: HIGHEST for action security_group_members [ 809.884220] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22fe3f10-da32-4a3d-99ce-11c807c6b585 with Priority: HIGHEST for action port [ 809.884220] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cda90900-060d-4f5f-a75d-9682dced28fb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.884220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.884220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.885126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.885209] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cda90900-060d-4f5f-a75d-9682dced28fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.886297] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda90900-060d-4f5f-a75d-9682dced28fb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.886395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.886395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.888171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.888171] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.888171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.888171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.888171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.888171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.888171] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cda90900-060d-4f5f-a75d-9682dced28fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.890573] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-22fe3f10-da32-4a3d-99ce-11c807c6b585 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.891667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22fe3f10-da32-4a3d-99ce-11c807c6b585" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.891667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22fe3f10-da32-4a3d-99ce-11c807c6b585" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.891667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22fe3f10-da32-4a3d-99ce-11c807c6b585" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.891667] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22fe3f10-da32-4a3d-99ce-11c807c6b585',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.321446] env[65553]: INFO networking_nsxv3.common.synchronization [req-d6a04eb6-2950-482c-a528-367341b4d821 req-8e071a11-8fb0-42c8-be10-5175c89cfb08 tempest-MigrationsAdminTest-418950081 tempest-MigrationsAdminTest-418950081-project-member] Enqueued Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 810.322129] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 810.322362] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.322505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.322578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.322736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.322893] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.322978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.323049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.323197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.323283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.323378] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.398353] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cda90900-060d-4f5f-a75d-9682dced28fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.398353] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda90900-060d-4f5f-a75d-9682dced28fb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.398353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.398353] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22fe3f10-da32-4a3d-99ce-11c807c6b585 with status ACTIVE [ 810.398353] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.398353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.398353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.398353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.398353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.398353] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.398353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.398353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.398353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.398353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.399049] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.399049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.399049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.399049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.399049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.399049] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22fe3f10-da32-4a3d-99ce-11c807c6b585 is going to be updated. [ 810.424775] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.424990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.424990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.425208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.425344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22fe3f10-da32-4a3d-99ce-11c807c6b585" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.694736] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.695720] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.695720] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.695720] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.696736] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.696736] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.696736] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.696736] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.696987] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.697099] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.698551] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.698695] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.698806] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.698944] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.699054] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.699186] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.721036] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.721253] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 810.721301] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.721465] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-327" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.721805] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-eadf7be3-950b-4d23-83d2-8c816b79ae7c taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.721971] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-eadf7be3-950b-4d23-83d2-8c816b79ae7c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.722096] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-eadf7be3-950b-4d23-83d2-8c816b79ae7c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.722436] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-eadf7be3-950b-4d23-83d2-8c816b79ae7c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.722566] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eadf7be3-950b-4d23-83d2-8c816b79ae7c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.825804] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.902509] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cda90900-060d-4f5f-a75d-9682dced28fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.225490] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.225813] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.225962] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.226286] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.226432] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.226600] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port eadf7be3-950b-4d23-83d2-8c816b79ae7c not found, creating... [ 811.226877] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.227043] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.227156] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.227373] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.227507] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.227833] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.227989] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.228117] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.228320] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.228447] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.228579] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: eadf7be3-950b-4d23-83d2-8c816b79ae7c is going to be created. [ 811.249543] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.249770] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.249921] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.250257] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.250451] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.250675] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-eadf7be3-950b-4d23-83d2-8c816b79ae7c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.328756] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.405470] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.405737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.405857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.406109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.406241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.406408] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda90900-060d-4f5f-a75d-9682dced28fb is going to be created. [ 811.443442] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.443754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.443754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.443933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.444125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.456691] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda90900-060d-4f5f-a75d-9682dced28fb in Status: UNINITIALIZED for 2s [ 811.831793] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.831973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.832038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.832349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.832468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.832604] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 is going to be updated. [ 811.878207] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.878448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.878448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.878624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.878768] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.902520] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: IN_PROGRESS for 2s [ 811.997580] env[65553]: INFO networking_nsxv3.common.synchronization [req-d6a04eb6-2950-482c-a528-367341b4d821 req-130fe9a6-2b80-4ecd-a0cb-43f6207f86cc service nova] Enqueued Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_rules [ 811.997781] env[65553]: INFO networking_nsxv3.common.synchronization [req-d6a04eb6-2950-482c-a528-367341b4d821 req-130fe9a6-2b80-4ecd-a0cb-43f6207f86cc service nova] Enqueued Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 811.997958] env[65553]: INFO networking_nsxv3.common.synchronization [req-d6a04eb6-2950-482c-a528-367341b4d821 req-130fe9a6-2b80-4ecd-a0cb-43f6207f86cc service nova] Enqueued Resource ID: eadf7be3-950b-4d23-83d2-8c816b79ae7c with Priority: HIGHEST for action port [ 811.998672] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_rules [ 811.998818] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 811.998959] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eadf7be3-950b-4d23-83d2-8c816b79ae7c with Priority: HIGHEST for action port [ 811.999393] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.999568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.999655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.999991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.000176] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.001184] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.001418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.001671] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-eadf7be3-950b-4d23-83d2-8c816b79ae7c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.001789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eadf7be3-950b-4d23-83d2-8c816b79ae7c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.001853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eadf7be3-950b-4d23-83d2-8c816b79ae7c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.002096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eadf7be3-950b-4d23-83d2-8c816b79ae7c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.002163] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eadf7be3-950b-4d23-83d2-8c816b79ae7c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.504817] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.505346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.505346] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eadf7be3-950b-4d23-83d2-8c816b79ae7c with status ACTIVE [ 812.505346] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.505565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.505565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.506215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.506215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.506215] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.506215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.506215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.507372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.507372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.507372] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.507372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.507372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.507372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.507372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.507372] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eadf7be3-950b-4d23-83d2-8c816b79ae7c is going to be updated. [ 812.534451] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.534451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.534451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.534822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.535014] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.535226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eadf7be3-950b-4d23-83d2-8c816b79ae7c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.370221] env[65553]: INFO networking_nsxv3.common.synchronization [None req-27ed4e52-bad9-4995-816e-76330a04821e None None] Enqueued Resource ID: 6fb37328-f85c-49d7-bb11-1d28c402ae25 with Priority: HIGHEST for action port [ 813.370847] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb37328-f85c-49d7-bb11-1d28c402ae25 with Priority: HIGHEST for action port [ 813.371280] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fb37328-f85c-49d7-bb11-1d28c402ae25 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.371280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fb37328-f85c-49d7-bb11-1d28c402ae25" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.371280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fb37328-f85c-49d7-bb11-1d28c402ae25" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.371489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fb37328-f85c-49d7-bb11-1d28c402ae25" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.371600] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb37328-f85c-49d7-bb11-1d28c402ae25',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.467463] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda90900-060d-4f5f-a75d-9682dced28fb in Status: SUCCESS [ 813.467694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.467917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.468314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.468553] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.468762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.468877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.469108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.469108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.469225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.469259] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cda90900-060d-4f5f-a75d-9682dced28fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.873581] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fb37328-f85c-49d7-bb11-1d28c402ae25 [ 813.873913] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.874056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.874056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.875031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.875031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.875031] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fb37328-f85c-49d7-bb11-1d28c402ae25 already deleted. [ 813.875031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fb37328-f85c-49d7-bb11-1d28c402ae25" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.917547] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: SUCCESS [ 813.917712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.917899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.918152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.918353] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.918508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.918548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.918692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.918809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.918929] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.974871] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda90900-060d-4f5f-a75d-9682dced28fb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.974871] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.974871] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda90900-060d-4f5f-a75d-9682dced28fb taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.974871] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.975830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.975830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.975830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.975830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.975830] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cda90900-060d-4f5f-a75d-9682dced28fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.226062] env[65553]: INFO networking_nsxv3.common.synchronization [req-a7fc8eff-bc9c-4eff-82a9-dca1b8023e9d req-cd80a04c-fb80-4231-864e-ade306b95dc5 tempest-MultipleCreateTestJSON-1937935220 tempest-MultipleCreateTestJSON-1937935220-project-member] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 814.226868] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 814.226965] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.227131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.227231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.227426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.227729] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.228026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.229147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.229392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.229511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.229634] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.423866] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.477130] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cda90900-060d-4f5f-a75d-9682dced28fb: rpc.has_security_group_logging(os_id): False [ 814.498174] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.498400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.498400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.498637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.498724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.498966] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.499171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.499171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.499324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.499419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.499605] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.499688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.499736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.499905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.499971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.500206] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.500474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.500474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.501142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.501142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.501264] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cda90900-060d-4f5f-a75d-9682dced28fb is going to be created. [ 814.608903] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.609103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.609103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.609316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.609504] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.627233] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cda90900-060d-4f5f-a75d-9682dced28fb in Status: IN_PROGRESS for 2s [ 814.732871] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.736021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.736021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.736021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.736021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.736021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.736021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.736021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.736021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.736021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.736021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 814.739707] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-128 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.740364] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.740665] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.741086] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.741575] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.742051] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.742294] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.742693] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.742997] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.743456] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.743710] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.743961] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.745038] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.745038] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.745038] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.745038] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.783044] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.783044] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.783044] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.783668] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.784356] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-ce101dbe-7d29-4a48-b194-3196b896683c taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.784857] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-ce101dbe-7d29-4a48-b194-3196b896683c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.785757] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-ce101dbe-7d29-4a48-b194-3196b896683c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.786327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-ce101dbe-7d29-4a48-b194-3196b896683c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.786897] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce101dbe-7d29-4a48-b194-3196b896683c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.797032] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.797032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.797032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.797032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.797032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.812659] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 814.927205] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.292034] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.292318] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.292447] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.292773] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.292989] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.293261] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port ce101dbe-7d29-4a48-b194-3196b896683c not found, creating... [ 815.293664] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.293852] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.293971] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.294211] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.294347] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.294765] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.294838] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.294933] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.295666] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.295666] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.295666] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: ce101dbe-7d29-4a48-b194-3196b896683c is going to be created. [ 815.319288] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.319503] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.319551] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.319883] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.320139] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.320367] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-ce101dbe-7d29-4a48-b194-3196b896683c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.432409] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.432409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.432409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.432409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.432409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.432409] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 is going to be updated. [ 815.477018] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.477018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.477018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.477018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.477018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.490082] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: IN_PROGRESS for 2s [ 815.738806] env[65553]: INFO networking_nsxv3.common.synchronization [None req-9eb588a0-92d2-4026-a5f2-71d0f4904f0d None None] Enqueued Resource ID: bfafda1a-6678-46da-a319-1565806bca6c with Priority: HIGHEST for action port [ 815.739647] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfafda1a-6678-46da-a319-1565806bca6c with Priority: HIGHEST for action port [ 815.739932] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfafda1a-6678-46da-a319-1565806bca6c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.740888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfafda1a-6678-46da-a319-1565806bca6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.740977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfafda1a-6678-46da-a319-1565806bca6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.743151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfafda1a-6678-46da-a319-1565806bca6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.743151] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfafda1a-6678-46da-a319-1565806bca6c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.757190] env[65553]: INFO networking_nsxv3.common.synchronization [None req-342aba29-835e-490e-a8c9-0e442b23f797 None None] Enqueued Resource ID: f5434656-8c5f-449c-9bde-0560cb13575b with Priority: HIGHEST for action port [ 815.759779] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5434656-8c5f-449c-9bde-0560cb13575b with Priority: HIGHEST for action port [ 815.760632] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5434656-8c5f-449c-9bde-0560cb13575b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.760632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5434656-8c5f-449c-9bde-0560cb13575b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.760891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5434656-8c5f-449c-9bde-0560cb13575b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.760952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5434656-8c5f-449c-9bde-0560cb13575b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.761035] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5434656-8c5f-449c-9bde-0560cb13575b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.023978] env[65553]: INFO networking_nsxv3.common.synchronization [req-a7fc8eff-bc9c-4eff-82a9-dca1b8023e9d req-a4d42b87-f141-43e9-84d5-9179157cbf35 service nova] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_rules [ 816.024739] env[65553]: INFO networking_nsxv3.common.synchronization [req-a7fc8eff-bc9c-4eff-82a9-dca1b8023e9d req-a4d42b87-f141-43e9-84d5-9179157cbf35 service nova] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 816.024739] env[65553]: INFO networking_nsxv3.common.synchronization [req-a7fc8eff-bc9c-4eff-82a9-dca1b8023e9d req-a4d42b87-f141-43e9-84d5-9179157cbf35 service nova] Enqueued Resource ID: ce101dbe-7d29-4a48-b194-3196b896683c with Priority: HIGHEST for action port [ 816.025288] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_rules [ 816.027742] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 816.028070] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce101dbe-7d29-4a48-b194-3196b896683c with Priority: HIGHEST for action port [ 816.029235] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.031045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.031045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.031045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.031045] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.032415] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.032579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.032920] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce101dbe-7d29-4a48-b194-3196b896683c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.033147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce101dbe-7d29-4a48-b194-3196b896683c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.033818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce101dbe-7d29-4a48-b194-3196b896683c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.033933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce101dbe-7d29-4a48-b194-3196b896683c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.034119] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce101dbe-7d29-4a48-b194-3196b896683c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.245151] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfafda1a-6678-46da-a319-1565806bca6c [ 816.245317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.245619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.245619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.245893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.245893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.245979] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfafda1a-6678-46da-a319-1565806bca6c already deleted. [ 816.246070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfafda1a-6678-46da-a319-1565806bca6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.263950] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5434656-8c5f-449c-9bde-0560cb13575b [ 816.265191] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.265191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.265191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.265191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.265191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.265191] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5434656-8c5f-449c-9bde-0560cb13575b already deleted. [ 816.265191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5434656-8c5f-449c-9bde-0560cb13575b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.276889] env[65553]: INFO networking_nsxv3.common.synchronization [req-8446214e-eab1-4d9e-81bc-1f5c221b8b13 req-16617afa-c312-469c-95d1-55a623de6a41 tempest-ServersAdminNegativeTestJSON-2073833851 tempest-ServersAdminNegativeTestJSON-2073833851-project-member] Enqueued Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 816.277481] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGHEST for action security_group_members [ 816.279061] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.279241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.279313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.279526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.279729] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.279856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.279916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.280100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.280199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.280302] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.538140] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce101dbe-7d29-4a48-b194-3196b896683c with status ACTIVE [ 816.538443] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.538640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.538727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.538914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.539017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.539278] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.539409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.539468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.539602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.539714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.539965] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.540155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.540238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.540442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.540576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.540691] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce101dbe-7d29-4a48-b194-3196b896683c is going to be updated. [ 816.544504] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.545210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.580539] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.580539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.580539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.580539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.580539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.580539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce101dbe-7d29-4a48-b194-3196b896683c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.651397] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cda90900-060d-4f5f-a75d-9682dced28fb in Status: SUCCESS [ 816.651397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.785016] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.785166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.785166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.786038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.786038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.786038] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.786038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.786038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.786038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.786038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.786429] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 is going to be updated. [ 816.832943] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 816.833191] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 deletion is rescheduled due to dependency. [ 816.833311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.833475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.833810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.834009] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.834144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.834209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.835409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.835409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.835409] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.843657] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.843931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.844031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.844240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.844415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.857418] env[65553]: INFO networking_nsxv3.common.synchronization [req-a7fc8eff-bc9c-4eff-82a9-dca1b8023e9d req-4d6e2250-31b5-4274-a34d-1a8befc08320 tempest-MultipleCreateTestJSON-1937935220 tempest-MultipleCreateTestJSON-1937935220-project-member] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 816.859191] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: IN_PROGRESS for 2s [ 816.859339] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 816.859633] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.859798] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.009659] env[65553]: INFO networking_nsxv3.common.synchronization [None req-ccccec4a-f7ad-4207-97fb-13ee6199523a tempest-ServerActionsV293TestJSON-138104853 tempest-ServerActionsV293TestJSON-138104853-project-member] Enqueued Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_rules [ 817.010282] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_rules [ 817.010600] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-762d4374-c484-417a-aad8-0a36a186516f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.010715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.010779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.011081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.011171] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('762d4374-c484-417a-aad8-0a36a186516f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.163446] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d12829cf-985f-4164-b404-dd171066397e tempest-ServerActionsV293TestJSON-138104853 tempest-ServerActionsV293TestJSON-138104853-project-member] Enqueued Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_rules [ 817.163788] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_rules [ 817.164009] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-762d4374-c484-417a-aad8-0a36a186516f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.166855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.263930] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-128 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.264593] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.264593] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.264593] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.265688] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.265970] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.270018] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.270018] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.270018] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.270018] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.270018] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.270018] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.270018] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.270018] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.270018] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.270018] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.300289] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.304027] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 817.304027] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.304027] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-128" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.304027] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-4a2f1dad-e2ca-492a-a7a2-3049bbda7741 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.304027] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-4a2f1dad-e2ca-492a-a7a2-3049bbda7741" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.304027] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-4a2f1dad-e2ca-492a-a7a2-3049bbda7741" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.304027] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-4a2f1dad-e2ca-492a-a7a2-3049bbda7741" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.304027] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2f1dad-e2ca-492a-a7a2-3049bbda7741',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.337240] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.502411] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: SUCCESS [ 817.502640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.502811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.503081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.503331] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.503494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.503494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.503620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.503699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.503782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.503877] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.533022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.533283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.533403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.533737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.533909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.534112] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 762d4374-c484-417a-aad8-0a36a186516f already deleted. [ 817.534266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.534959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.535580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.535811] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('762d4374-c484-417a-aad8-0a36a186516f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.808905] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.809152] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.809273] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.809543] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.809686] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.809834] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 4a2f1dad-e2ca-492a-a7a2-3049bbda7741 not found, creating... [ 817.810092] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.810255] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.810345] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.810560] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.810688] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.811021] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.811151] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.811247] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.811391] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.811512] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.811641] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 4a2f1dad-e2ca-492a-a7a2-3049bbda7741 is going to be created. [ 817.841098] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.845743] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.845977] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.846116] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.846388] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.846618] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.846877] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-4a2f1dad-e2ca-492a-a7a2-3049bbda7741" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.007025] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.010140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.010140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.010140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.010140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.011159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.011159] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.072377] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.072482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.072482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.072753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.072827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.072928] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 762d4374-c484-417a-aad8-0a36a186516f already deleted. [ 818.073025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.310700] env[65553]: INFO networking_nsxv3.common.synchronization [None req-42b07f7d-a158-48ce-abbf-4b2e5c19d93f None None] Enqueued Resource ID: 5ae4a246-4459-4c06-9c3e-8e3fdee613ad with Priority: HIGHEST for action port [ 818.312021] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae4a246-4459-4c06-9c3e-8e3fdee613ad with Priority: HIGHEST for action port [ 818.312021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ae4a246-4459-4c06-9c3e-8e3fdee613ad taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.312021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ae4a246-4459-4c06-9c3e-8e3fdee613ad" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.312220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ae4a246-4459-4c06-9c3e-8e3fdee613ad" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.312595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ae4a246-4459-4c06-9c3e-8e3fdee613ad" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.313460] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ae4a246-4459-4c06-9c3e-8e3fdee613ad',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.349808] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.349933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.349933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.350354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.350453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.350558] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 818.392016] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.392229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.392303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.392521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.392691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.405198] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 818.511917] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c7019e3-cf34-4117-9224-cf7758cc0cf6: rpc.has_security_group_logging(os_id): False [ 818.530396] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.530597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.530597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.530843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.530971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.531359] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.531463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.531503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.532071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.532071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.532071] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.532071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.532257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.532521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.532521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.532617] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.532676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.532721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.532870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.532930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.533043] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 is going to be updated. [ 818.617256] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d77ee3e2-417c-455d-8bd1-a94175ae06a0 tempest-ServersV294TestFqdnHostnames-1467859160 tempest-ServersV294TestFqdnHostnames-1467859160-project-member] Enqueued Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_rules [ 818.619399] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.619399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.619399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.619399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.619399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.622976] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_rules [ 818.623334] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-510c04b8-85b7-4488-b4cf-5880529fe0b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.623552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.623552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.623802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.623892] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.643469] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: IN_PROGRESS for 2s [ 818.659159] env[65553]: INFO networking_nsxv3.common.synchronization [req-a7fc8eff-bc9c-4eff-82a9-dca1b8023e9d req-63a17342-bb70-4a22-9e11-018b843b246b service nova] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_rules [ 818.659357] env[65553]: INFO networking_nsxv3.common.synchronization [req-a7fc8eff-bc9c-4eff-82a9-dca1b8023e9d req-63a17342-bb70-4a22-9e11-018b843b246b service nova] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 818.659489] env[65553]: INFO networking_nsxv3.common.synchronization [req-a7fc8eff-bc9c-4eff-82a9-dca1b8023e9d req-63a17342-bb70-4a22-9e11-018b843b246b service nova] Enqueued Resource ID: 4a2f1dad-e2ca-492a-a7a2-3049bbda7741 with Priority: HIGHEST for action port [ 818.664412] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_rules [ 818.664412] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 818.664412] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a2f1dad-e2ca-492a-a7a2-3049bbda7741 with Priority: HIGHEST for action port [ 818.665552] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.666028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.666295] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.666395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.666797] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a2f1dad-e2ca-492a-a7a2-3049bbda7741 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.666976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a2f1dad-e2ca-492a-a7a2-3049bbda7741" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.667092] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a2f1dad-e2ca-492a-a7a2-3049bbda7741" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.667572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a2f1dad-e2ca-492a-a7a2-3049bbda7741" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.667572] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2f1dad-e2ca-492a-a7a2-3049bbda7741',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.818483] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ae4a246-4459-4c06-9c3e-8e3fdee613ad [ 818.818483] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.818639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.818704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.818897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.818989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.819092] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ae4a246-4459-4c06-9c3e-8e3fdee613ad already deleted. [ 818.819171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ae4a246-4459-4c06-9c3e-8e3fdee613ad" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.823712] env[65553]: INFO networking_nsxv3.common.synchronization [None req-05772a0f-81f9-4d89-822a-1ac8b974bd2c tempest-ServersV294TestFqdnHostnames-1467859160 tempest-ServersV294TestFqdnHostnames-1467859160-project-member] Enqueued Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_rules [ 818.828145] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_rules [ 818.828677] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-510c04b8-85b7-4488-b4cf-5880529fe0b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.828677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.873074] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 in Status: SUCCESS [ 818.873074] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 deletion is rescheduled due to dependency. [ 818.873074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.161247] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.161421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.161475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.161925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.161925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.161925] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 already deleted. [ 819.162965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.163182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.163394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.163519] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.170303] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a2f1dad-e2ca-492a-a7a2-3049bbda7741 with status ACTIVE [ 819.170303] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.170303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.170303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.170508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.171534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.171534] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.173282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.173394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.177602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.177602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.177602] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.177602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.177602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.177602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.177602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.178153] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a2f1dad-e2ca-492a-a7a2-3049bbda7741 is going to be updated. [ 819.210830] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.210830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.211015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.211825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.211825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.211825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a2f1dad-e2ca-492a-a7a2-3049bbda7741" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.688954] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.689260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.689260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.690908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.690908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.690908] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 already deleted. [ 819.690908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.728777] env[65553]: INFO networking_nsxv3.common.synchronization [req-3ad6a4c7-277c-4688-acfb-83021663a7b4 req-df99802f-b088-4cc7-be45-c0770b166303 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 819.734374] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 819.734374] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.734374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.734374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.734374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.734374] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.735143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.735143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.735889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.735889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.735889] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.239383] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.419041] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 820.419041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.419041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.419041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.419041] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.419041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.419041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.419727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.419998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.420290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.420601] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.421892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.422384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.423954] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.425944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.425944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.425944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.425944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.425944] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.629111] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-968 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.629278] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-968" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.629381] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-968" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.629648] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-968" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.629906] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.630176] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.630300] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.630559] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.630743] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.630916] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.631050] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.631157] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.631211] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.631393] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.631511] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.631661] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.657160] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.657160] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 820.658232] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.658232] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-968" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.658232] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-96fae0e6-21a3-4592-8d8f-69a1e877b050 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.658232] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.658232] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.658527] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.658527] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96fae0e6-21a3-4592-8d8f-69a1e877b050',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.661597] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: SUCCESS [ 820.661815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.744870] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.929040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.929198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.929346] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.161339] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.161530] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.161710] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.162061] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.162281] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.162419] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 96fae0e6-21a3-4592-8d8f-69a1e877b050 not found, creating... [ 821.162787] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.163042] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.163117] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.163448] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.163674] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.164037] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.164281] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.164281] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.164605] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.164605] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.164871] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 96fae0e6-21a3-4592-8d8f-69a1e877b050 is going to be created. [ 821.196984] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.197294] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.197386] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.197571] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.197843] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.199346] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.252815] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.253056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.253144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.253363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.253462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.253557] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 821.288396] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.288396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.288396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.288396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.288396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.313487] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 821.433699] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.651287] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.651645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.651645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.651868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.651868] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.934964] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.935396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.935396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.935601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.935714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.935876] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 821.967965] env[65553]: INFO networking_nsxv3.common.synchronization [req-3ad6a4c7-277c-4688-acfb-83021663a7b4 req-86967e3b-22b0-4c7c-8fd5-f5dd273bb6b9 service nova] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 821.967965] env[65553]: INFO networking_nsxv3.common.synchronization [req-3ad6a4c7-277c-4688-acfb-83021663a7b4 req-86967e3b-22b0-4c7c-8fd5-f5dd273bb6b9 service nova] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 821.967965] env[65553]: INFO networking_nsxv3.common.synchronization [req-3ad6a4c7-277c-4688-acfb-83021663a7b4 req-86967e3b-22b0-4c7c-8fd5-f5dd273bb6b9 service nova] Enqueued Resource ID: 96fae0e6-21a3-4592-8d8f-69a1e877b050 with Priority: HIGHEST for action port [ 821.967965] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 821.967965] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 821.967965] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96fae0e6-21a3-4592-8d8f-69a1e877b050 with Priority: HIGHEST for action port [ 821.967965] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.967965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.967965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.967965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.967965] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.969256] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.969487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.970462] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-96fae0e6-21a3-4592-8d8f-69a1e877b050 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.970462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.970462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.970462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.970836] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96fae0e6-21a3-4592-8d8f-69a1e877b050',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.979353] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.981196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.981196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.981196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.981196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.993670] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 822.154492] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.337758] env[65553]: INFO networking_nsxv3.common.synchronization [req-567645cd-9a08-4fb1-8d99-86478d472b1d req-67d6a908-7c69-453e-967f-70c134b487f9 tempest-InstanceActionsV221TestJSON-797501730 tempest-InstanceActionsV221TestJSON-797501730-project-member] Enqueued Resource ID: cda90900-060d-4f5f-a75d-9682dced28fb with Priority: HIGHEST for action security_group_members [ 822.338584] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda90900-060d-4f5f-a75d-9682dced28fb with Priority: HIGHEST for action security_group_members [ 822.339009] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda90900-060d-4f5f-a75d-9682dced28fb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.339009] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.339142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.339268] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.339450] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.339574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.339644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.339831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.339976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.340819] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cda90900-060d-4f5f-a75d-9682dced28fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.472508] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.474295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.474579] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96fae0e6-21a3-4592-8d8f-69a1e877b050 with status ACTIVE [ 822.474792] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.474979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.475132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.475337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.475435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.475653] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.475844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.475905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.476117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.476196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.476438] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.477239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.477239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.477239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.477239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.477239] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96fae0e6-21a3-4592-8d8f-69a1e877b050 is going to be updated. [ 822.508744] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.509141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.509395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.509799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.510117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.510451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.657049] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.831159] env[65553]: INFO networking_nsxv3.common.synchronization [req-0728f494-8f52-463e-a023-cb43e770d16a req-c5790083-5e9d-4f89-854b-857e883c62c8 tempest-InstanceActionsTestJSON-1420156515 tempest-InstanceActionsTestJSON-1420156515-project-member] Enqueued Resource ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 with Priority: HIGHEST for action security_group_members [ 822.831711] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 with Priority: HIGHEST for action security_group_members [ 822.832017] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.832174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.832242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.832506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.832670] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.832774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.832830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.832984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.833500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.833652] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('118c9912-ceb9-4aa1-bdf0-c6f83f3943b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.844354] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.844567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.844567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.844757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.844845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.845045] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.845149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.845213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.845362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.845438] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.845522] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda90900-060d-4f5f-a75d-9682dced28fb is going to be updated. [ 822.876602] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.876901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.876988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.877208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.877351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.888115] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda90900-060d-4f5f-a75d-9682dced28fb in Status: IN_PROGRESS for 2s [ 823.159471] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 823.160473] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 823.249330] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.249625] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-252" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.249812] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-252" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.250564] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-252" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.250937] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.251430] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.251580] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.252125] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.252199] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.252437] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.252632] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.252831] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.253623] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.254028] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.254392] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.254526] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.281397] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.281593] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.281716] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.281889] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-252" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.282448] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-e30b24f0-31b9-4ec8-a2fd-cb686af287fe taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.282684] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-e30b24f0-31b9-4ec8-a2fd-cb686af287fe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.282807] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-e30b24f0-31b9-4ec8-a2fd-cb686af287fe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.283327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-e30b24f0-31b9-4ec8-a2fd-cb686af287fe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.283483] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e30b24f0-31b9-4ec8-a2fd-cb686af287fe',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.336147] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.336230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.336230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.336455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.336546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.336808] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.336918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.336975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.337143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.337232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.337342] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 already deleted. [ 823.337400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.345393] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 823.345530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.345625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.345874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.346091] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.346212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.346276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.346430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.346513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.346613] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.564741] env[65553]: INFO networking_nsxv3.common.synchronization [None req-4ac9be6b-9688-4662-a058-a13a850e573e None None] Enqueued Resource ID: 77312e20-6bb6-4df6-81a8-1fc1382b5593 with Priority: HIGHEST for action port [ 823.565534] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77312e20-6bb6-4df6-81a8-1fc1382b5593 with Priority: HIGHEST for action port [ 823.566133] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-77312e20-6bb6-4df6-81a8-1fc1382b5593 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.566370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77312e20-6bb6-4df6-81a8-1fc1382b5593" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.566531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77312e20-6bb6-4df6-81a8-1fc1382b5593" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.566940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77312e20-6bb6-4df6-81a8-1fc1382b5593" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.567139] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77312e20-6bb6-4df6-81a8-1fc1382b5593',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.789220] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.789551] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.790374] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.790374] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.790525] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.790629] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port e30b24f0-31b9-4ec8-a2fd-cb686af287fe not found, creating... [ 823.791266] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.791521] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.791717] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.792035] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.792294] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.792667] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.792896] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.793131] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.793382] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.793660] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.793884] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: e30b24f0-31b9-4ec8-a2fd-cb686af287fe is going to be created. [ 823.836936] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.837423] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.837561] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.837994] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.838469] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.838911] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-e30b24f0-31b9-4ec8-a2fd-cb686af287fe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.850418] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.027031] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 824.027289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.027427] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.027645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.029616] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.029736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.029736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.030014] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.030124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.030236] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.070411] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77312e20-6bb6-4df6-81a8-1fc1382b5593 [ 824.070411] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.070411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.070411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.071112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.071709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.071709] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77312e20-6bb6-4df6-81a8-1fc1382b5593 already deleted. [ 824.071709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77312e20-6bb6-4df6-81a8-1fc1382b5593" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.353873] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.535976] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.552416] env[65553]: INFO networking_nsxv3.common.synchronization [req-e734ae75-bfce-424d-9b60-0e41bf28cc6e req-4a09ab71-6087-44df-8e95-db73a93d50b6 tempest-ListServerFiltersTestJSON-2035845723 tempest-ListServerFiltersTestJSON-2035845723-project-member] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 824.557529] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGHEST for action security_group_members [ 824.557529] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.557529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.557529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.557529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.557529] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.557529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.557529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.557529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.557529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.557529] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.571562] env[65553]: INFO networking_nsxv3.common.synchronization [req-0728f494-8f52-463e-a023-cb43e770d16a req-3ab962ac-9cab-45a3-9f9b-b3755d9ad3ab service nova] Enqueued Resource ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 with Priority: HIGHEST for action security_group_rules [ 824.571562] env[65553]: INFO networking_nsxv3.common.synchronization [req-0728f494-8f52-463e-a023-cb43e770d16a req-3ab962ac-9cab-45a3-9f9b-b3755d9ad3ab service nova] Enqueued Resource ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 with Priority: HIGHEST for action security_group_members [ 824.571562] env[65553]: INFO networking_nsxv3.common.synchronization [req-0728f494-8f52-463e-a023-cb43e770d16a req-3ab962ac-9cab-45a3-9f9b-b3755d9ad3ab service nova] Enqueued Resource ID: e30b24f0-31b9-4ec8-a2fd-cb686af287fe with Priority: HIGHEST for action port [ 824.571789] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 with Priority: HIGHEST for action security_group_rules [ 824.571970] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 with Priority: HIGHEST for action security_group_members [ 824.572131] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e30b24f0-31b9-4ec8-a2fd-cb686af287fe with Priority: HIGHEST for action port [ 824.572443] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.572560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.572652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.573016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.574307] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('118c9912-ceb9-4aa1-bdf0-c6f83f3943b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.576961] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.576961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.576961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.576961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.576961] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.576961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.576961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.576961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.577299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.577750] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('118c9912-ceb9-4aa1-bdf0-c6f83f3943b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.579049] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e30b24f0-31b9-4ec8-a2fd-cb686af287fe taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.579180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e30b24f0-31b9-4ec8-a2fd-cb686af287fe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.579235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e30b24f0-31b9-4ec8-a2fd-cb686af287fe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.579422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e30b24f0-31b9-4ec8-a2fd-cb686af287fe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.580269] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e30b24f0-31b9-4ec8-a2fd-cb686af287fe',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.808441] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.808441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.808441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.808441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.983111] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 824.984237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.985375] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 824.990786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.990786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.990786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.990786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.990786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.990786] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 824.993063] env[65553]: INFO networking_nsxv3.common.synchronization [req-22761537-5154-4f60-beee-4f555c05defa req-1689040d-0ba0-40bf-83ac-503bd646c1ee tempest-ServerMetadataTestJSON-1818714194 tempest-ServerMetadataTestJSON-1818714194-project-member] Enqueued Resource ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 with Priority: HIGHEST for action security_group_members [ 824.994456] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 with Priority: HIGHEST for action security_group_members [ 824.995046] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f80555d1-ee88-4624-af40-5a9e62b1a6a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.995173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.995253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.995489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.995729] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.995805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.995805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.995963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.996053] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.996209] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f80555d1-ee88-4624-af40-5a9e62b1a6a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.017356] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda90900-060d-4f5f-a75d-9682dced28fb in Status: SUCCESS [ 825.017356] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda90900-060d-4f5f-a75d-9682dced28fb deletion is rescheduled due to dependency. [ 825.017356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.039042] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.039042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.039042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.039042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.046358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.047153] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 825.047273] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 825.047361] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 825.048469] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.050375] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.050532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.050606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.050830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.050978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.059697] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.059882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.059882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.060069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.060160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.060352] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.060445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.060504] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.060648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.060721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.060805] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be updated. [ 825.069398] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 825.084131] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.084292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.084469] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('118c9912-ceb9-4aa1-bdf0-c6f83f3943b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.087707] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e30b24f0-31b9-4ec8-a2fd-cb686af287fe with status ACTIVE [ 825.087912] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.088054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.088123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.088336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.088422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.088618] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.088692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.088753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.088893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.088978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.089278] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.089408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.089472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.089618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.089695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.089781] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e30b24f0-31b9-4ec8-a2fd-cb686af287fe is going to be updated. [ 825.095746] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.095932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.095932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.096181] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.096326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.121442] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: IN_PROGRESS for 2s [ 825.130289] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.130470] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.130596] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.134256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.134256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.134256] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 825.147732] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.148647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.148647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.148647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.148647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.148647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e30b24f0-31b9-4ec8-a2fd-cb686af287fe" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.391644] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-494 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.392017] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-494" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.392148] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-494" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.392437] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-494" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.392747] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.392958] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.393057] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.393431] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.393662] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.393952] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.394088] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.394192] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.394318] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.394445] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.394569] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.394750] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.460252] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.460252] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.064 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 825.460252] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.460252] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-494" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.460252] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-d3565969-038a-4d29-b7ab-20104f355f6c taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.460252] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-d3565969-038a-4d29-b7ab-20104f355f6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.460252] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-d3565969-038a-4d29-b7ab-20104f355f6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.462319] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-d3565969-038a-4d29-b7ab-20104f355f6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.462319] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3565969-038a-4d29-b7ab-20104f355f6c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.496497] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.496761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.496946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.497240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.497488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.497841] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 825.499528] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.499673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.500113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.500113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.500308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.500924] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.500924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.500924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.501252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.501252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.501326] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 already deleted. [ 825.501470] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.555276] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.555602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.555762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.556160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.556371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.556539] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 825.591029] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('118c9912-ceb9-4aa1-bdf0-c6f83f3943b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.649501] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.649501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.649501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.649501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.649501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.671433] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 825.751480] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.751801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.751915] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.752189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.752457] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.752739] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:37. [ 825.752883] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd', 'dfefe395-d857-43f0-952f-7a8984da2f70', '330e4cbb-c145-4a73-968c-26c6765a2388', 'd1246751-d3c4-4099-b16f-aa9fe0e1b1a6', '2ed73c0e-357c-432a-a683-eda251f6d85a', 'dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9', 'f4ee4c50-7cd1-464f-8791-a617053e06f6', 'edac77c9-fa82-4dc9-b52a-a8a880305683', '5c7019e3-cf34-4117-9224-cf7758cc0cf6', 'a86c04db-ddf8-419d-8a90-125d10e637f6', 'd069dc70-d382-4790-b884-3c9bf5e88eb0', '5f345373-ada8-463f-8791-7b6fdbbaba03', '6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb', 'adbdb58c-5387-4b80-952f-8897a8d0f9c9', '0c96c798-8819-41b0-9168-410c415c2391', '18b16119-4a62-4859-895e-b0f3732128ff', 'b5b58f96-24da-4b03-965a-558253f0ed7f', '45ed7e07-211b-423b-917e-bf729b9b3c70', 'cda90900-060d-4f5f-a75d-9682dced28fb', 'a5850b07-8815-476d-8023-18db057487e0', '4a425597-2f3a-4763-9abe-b15432eceec7', '15032a54-f6e7-41b8-855b-0262e8fb39c5', '47ac6222-df91-40b6-8703-f88ab52afe33', 'de664cf7-0945-48b8-9372-6d843b23be0e', '84881d5c-05c0-4bde-84e9-437b2da92669', '30f1992f-8f85-4326-932f-434571d97d70', 'b7d6f932-0d6e-4b85-a4f1-f60e841549d8', 'f3d9a09b-bf97-4de9-910d-f878fc6b267c', 'ec66a418-d823-4b2f-87e2-c61e09ea9de4', '54d93d69-4c1f-45f9-bd84-41ef7facb6ae', 'ebd49ee0-d72a-443f-a112-9fa0a970c7be', '28be331c-2041-41ac-9f2a-5746e8762908', 'ad458bc8-8a48-49a7-9f97-e510476fdf4f', 'a7ba6400-0dc9-4a80-ad83-aeeb3037ae85', '1e7647e8-bc93-4ca1-af77-c7da9c980011', '75ff2ed9-6e49-4d62-a3e7-345569ebb0f7', 'fd69ea1e-9ecd-47c1-b65c-87418794c033'} {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 825.753132] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 825.783962] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.784224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.784346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.784589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.784672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.784787] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 825.784855] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 825.784920] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 825.901942] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.902357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.902857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.903272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.904779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.905535] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 825.905736] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 825.905918] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 825.906129] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 825.906357] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/37 resources of Type:Security Group Rules [ 825.906517] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGH for action security_group_rules [ 825.906653] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGH for action security_group_rules [ 825.906821] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGH for action security_group_rules [ 825.906933] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGH for action security_group_rules [ 825.907117] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGH for action security_group_rules [ 825.907361] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGH for action security_group_rules [ 825.907662] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGH for action security_group_rules [ 825.907864] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGH for action security_group_rules [ 825.908059] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGH for action security_group_rules [ 825.908197] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGH for action security_group_rules [ 825.908334] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGH for action security_group_rules [ 825.908443] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGH for action security_group_rules [ 825.908561] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGH for action security_group_rules [ 825.908715] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 with Priority: HIGH for action security_group_rules [ 825.908826] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGH for action security_group_rules [ 825.908938] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGH for action security_group_rules [ 825.909124] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5b58f96-24da-4b03-965a-558253f0ed7f with Priority: HIGH for action security_group_rules [ 825.909220] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 with Priority: HIGH for action security_group_rules [ 825.909355] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cda90900-060d-4f5f-a75d-9682dced28fb with Priority: HIGH for action security_group_rules [ 825.909441] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGH for action security_group_rules [ 825.909562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.949136] env[65553]: INFO networking_nsxv3.common.synchronization [None req-19e3dc51-3cf5-44ce-abc9-fbd0738391a6 tempest-ServerActionsTestOtherB-2131075409 tempest-ServerActionsTestOtherB-2131075409-project-member] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 825.949894] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 825.950195] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd with Priority: HIGH for action security_group_rules [ 825.950392] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGH for action security_group_rules [ 825.950563] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGH for action security_group_rules [ 825.950735] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGH for action security_group_rules [ 825.950921] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5850b07-8815-476d-8023-18db057487e0 with Priority: HIGH for action security_group_rules [ 825.951121] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda90900-060d-4f5f-a75d-9682dced28fb with Priority: HIGH for action security_group_rules [ 825.951295] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 with Priority: HIGH for action security_group_rules [ 825.951475] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b58f96-24da-4b03-965a-558253f0ed7f with Priority: HIGH for action security_group_rules [ 825.951639] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 with Priority: HIGH for action security_group_rules [ 825.951805] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGH for action security_group_rules [ 825.951969] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb with Priority: HIGH for action security_group_rules [ 825.952162] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGH for action security_group_rules [ 825.952331] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGH for action security_group_rules [ 825.952567] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGH for action security_group_rules [ 825.952763] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGH for action security_group_rules [ 825.952763] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 with Priority: HIGH for action security_group_rules [ 825.952902] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edac77c9-fa82-4dc9-b52a-a8a880305683 with Priority: HIGH for action security_group_rules [ 825.953073] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGH for action security_group_rules [ 825.953226] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfefe395-d857-43f0-952f-7a8984da2f70 with Priority: HIGH for action security_group_rules [ 825.953389] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGH for action security_group_rules [ 825.953898] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.954219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.954329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.954815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.954991] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.956299] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.956584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.956717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.956908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.957047] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.958850] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.958850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.958850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.959259] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.959259] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.961980] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.961980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.961980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.961980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.961980] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.962802] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.962802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.963109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.963202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.963294] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.965624] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5850b07-8815-476d-8023-18db057487e0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.965779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.966725] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.967010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.967140] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5850b07-8815-476d-8023-18db057487e0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.968665] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cda90900-060d-4f5f-a75d-9682dced28fb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.968751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.968855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.969558] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.969558] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cda90900-060d-4f5f-a75d-9682dced28fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.970694] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45ed7e07-211b-423b-917e-bf729b9b3c70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.970902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.970966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.971284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.971416] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45ed7e07-211b-423b-917e-bf729b9b3c70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.975827] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5b58f96-24da-4b03-965a-558253f0ed7f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.976051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.976051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.976301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.976417] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5b58f96-24da-4b03-965a-558253f0ed7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.976865] env[65553]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 825.978701] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adbdb58c-5387-4b80-952f-8897a8d0f9c9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.978853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.979037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.979339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.979528] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adbdb58c-5387-4b80-952f-8897a8d0f9c9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.980973] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18b16119-4a62-4859-895e-b0f3732128ff taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.981250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.981350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.981622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.981735] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.983264] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.983421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.983517] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.983778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.983890] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.985483] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.985621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.985918] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.986098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.986203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.986457] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.986579] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.988086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.988241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.988525] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.988674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.988748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.988988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.989134] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.990479] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.990693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.990802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.991056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.991176] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.992680] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edac77c9-fa82-4dc9-b52a-a8a880305683 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.992844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.992991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.993224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.993491] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edac77c9-fa82-4dc9-b52a-a8a880305683',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.994670] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.994774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.994822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.995084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.995159] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.996435] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfefe395-d857-43f0-952f-7a8984da2f70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.996906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.996906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.997172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.997172] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfefe395-d857-43f0-952f-7a8984da2f70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.998515] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.998661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.998756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.999215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.999215] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.999435] env[65553]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 826.007817] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.007817] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.007817] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.008093] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.008311] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.008637] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port d3565969-038a-4d29-b7ab-20104f355f6c not found, creating... [ 826.009172] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.009432] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.009627] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.009967] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.010290] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.010751] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.010988] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.011179] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.011502] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.011791] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.013041] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: d3565969-038a-4d29-b7ab-20104f355f6c is going to be created. [ 826.053152] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.053482] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.053683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.054383] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.054923] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.055041] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-d3565969-038a-4d29-b7ab-20104f355f6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.089745] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.089984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.089984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.090358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.090358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.090491] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 is going to be created. [ 826.161639] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.161811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.162039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.162261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.162676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.176530] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 in Status: UNINITIALIZED for 2s [ 826.183128] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f3fb67fc-b851-46dd-9a88-b5f26b0b8c97 tempest-ServerActionsTestOtherB-2131075409 tempest-ServerActionsTestOtherB-2131075409-project-member] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 826.184020] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 826.184255] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.184368] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.504788] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.505334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.505334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.505334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.505495] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.505701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.505847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.506041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.506181] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.506359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.506474] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.531660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.531873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.531924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.532200] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.532300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.532396] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a already deleted. [ 826.532481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.533956] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.534045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.534045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.534335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.535606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.535956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.535956] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.546890] env[65553]: INFO networking_nsxv3.common.synchronization [None req-508fce71-39f7-4914-8671-2c7162933dc1 None None] Enqueued Resource ID: cf3065fd-a551-4a61-9dea-d92141a7d230 with Priority: HIGHEST for action port [ 826.547650] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf3065fd-a551-4a61-9dea-d92141a7d230 with Priority: HIGHEST for action port [ 826.547978] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf3065fd-a551-4a61-9dea-d92141a7d230 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.548205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf3065fd-a551-4a61-9dea-d92141a7d230" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.548205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf3065fd-a551-4a61-9dea-d92141a7d230" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.548524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf3065fd-a551-4a61-9dea-d92141a7d230" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.548615] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf3065fd-a551-4a61-9dea-d92141a7d230',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.551535] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.551660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.551730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.552402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.552402] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.552402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.552402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.552402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.552759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.552759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.552759] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.555221] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.555298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.555340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.555480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.555637] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.555776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.555842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.556036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.556286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.556286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.556286] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.560779] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.560779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.560995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.561042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.561208] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.561305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.561645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.561831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.561918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.562020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.562100] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.564966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.565138] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd is going to be deleted. [ 826.573935] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.573935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.573935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.573935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.573935] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.573935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.574212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.574212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.574289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.574567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.574567] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.576860] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b16119-4a62-4859-895e-b0f3732128ff taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.577010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.577010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.577167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.577317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.577412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.577474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.577624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.577702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.577793] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.577933] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.592554] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.592691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.594641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.594641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.649692] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.649963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.650935] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.651119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.652379] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.652506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.659097] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.659351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.660262] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.660427] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.661535] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.661654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.662660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.662799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.676034] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.676271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.690871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.691080] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5b58f96-24da-4b03-965a-558253f0ed7f is going to be deleted. [ 826.692230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.692534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.703357] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.703357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.714334] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.714479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.735211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.735646] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be deleted. [ 826.736649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.736908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.761581] env[65553]: INFO networking_nsxv3.common.synchronization [req-22761537-5154-4f60-beee-4f555c05defa req-0674b04a-e608-4245-ad83-8a85fde8f9ac service nova] Enqueued Resource ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 with Priority: HIGHEST for action security_group_rules [ 826.761706] env[65553]: INFO networking_nsxv3.common.synchronization [req-22761537-5154-4f60-beee-4f555c05defa req-0674b04a-e608-4245-ad83-8a85fde8f9ac service nova] Enqueued Resource ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 with Priority: HIGHEST for action security_group_members [ 826.761841] env[65553]: INFO networking_nsxv3.common.synchronization [req-22761537-5154-4f60-beee-4f555c05defa req-0674b04a-e608-4245-ad83-8a85fde8f9ac service nova] Enqueued Resource ID: d3565969-038a-4d29-b7ab-20104f355f6c with Priority: HIGHEST for action port [ 826.762502] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 with Priority: HIGHEST for action security_group_rules [ 826.762642] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 with Priority: HIGHEST for action security_group_members [ 826.762642] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3565969-038a-4d29-b7ab-20104f355f6c with Priority: HIGHEST for action port [ 826.762960] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f80555d1-ee88-4624-af40-5a9e62b1a6a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.763035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.763100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.763361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.763445] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f80555d1-ee88-4624-af40-5a9e62b1a6a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.764628] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f80555d1-ee88-4624-af40-5a9e62b1a6a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.764754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.765038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.765367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.765589] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.765589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.765589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.765754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.765852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.766174] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f80555d1-ee88-4624-af40-5a9e62b1a6a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.767198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3565969-038a-4d29-b7ab-20104f355f6c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.767321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3565969-038a-4d29-b7ab-20104f355f6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.767377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3565969-038a-4d29-b7ab-20104f355f6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.767516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3565969-038a-4d29-b7ab-20104f355f6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.767593] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3565969-038a-4d29-b7ab-20104f355f6c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.818479] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.818479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.839943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.839943] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edac77c9-fa82-4dc9-b52a-a8a880305683 is going to be deleted. [ 826.840844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.840844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.888869] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.889104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.936367] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.936367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.950045] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 826.950614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.950774] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5850b07-8815-476d-8023-18db057487e0 is going to be deleted. [ 826.951966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.953380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.015157] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.051263] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf3065fd-a551-4a61-9dea-d92141a7d230 [ 827.051613] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.052322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.052322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.052322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.052322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.052879] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf3065fd-a551-4a61-9dea-d92141a7d230 already deleted. [ 827.052879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf3065fd-a551-4a61-9dea-d92141a7d230" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.058296] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.067711] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.068458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.068458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.068458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.068663] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.068981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.068981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.068981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.069275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.069275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.069275] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.069398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.069398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.069540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.069674] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.069765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.069896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.070051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.070147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.070264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.070359] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.072810] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.091363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.091363] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cda90900-060d-4f5f-a75d-9682dced28fb is going to be deleted. [ 827.092802] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.092802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.092802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.093318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.094117] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.094117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.094117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.094117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.094117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.094117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.094445] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.094677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.095015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.095138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.095386] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.095488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.095779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.095971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.096058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.096175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.096292] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.099193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.100610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.100610] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.107224] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 827.107224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.108035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.108281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.108464] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.108585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.108643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.108805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.108885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.109032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.109087] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.116473] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.116654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.126190] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.126190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.168277] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb in Status: SUCCESS [ 827.168451] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb deletion is rescheduled due to dependency. [ 827.168582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.198356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.198483] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb is going to be deleted. [ 827.199543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.199784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.201535] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.201642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.268457] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f80555d1-ee88-4624-af40-5a9e62b1a6a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.272786] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3565969-038a-4d29-b7ab-20104f355f6c with status ACTIVE [ 827.272786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.272786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.272786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.272786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.272786] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3565969-038a-4d29-b7ab-20104f355f6c is going to be updated. [ 827.273846] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f80555d1-ee88-4624-af40-5a9e62b1a6a6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.274056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.388827] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.389063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.389063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.389351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.389541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.389890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3565969-038a-4d29-b7ab-20104f355f6c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.392522] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.392522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.405180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.405404] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adbdb58c-5387-4b80-952f-8897a8d0f9c9 is going to be deleted. [ 827.407018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.407352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.503650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.503828] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9 is going to be deleted. [ 827.505284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.505609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.518326] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 330e4cbb-c145-4a73-968c-26c6765a2388: rpc.has_security_group_logging(os_id): False [ 827.561760] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1246751-d3c4-4099-b16f-aa9fe0e1b1a6: rpc.has_security_group_logging(os_id): False [ 827.574776] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c96c798-8819-41b0-9168-410c415c2391: rpc.has_security_group_logging(os_id): False [ 827.576278] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ed73c0e-357c-432a-a683-eda251f6d85a: rpc.has_security_group_logging(os_id): False [ 827.602870] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c7019e3-cf34-4117-9224-cf7758cc0cf6: rpc.has_security_group_logging(os_id): False [ 827.604644] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18b16119-4a62-4859-895e-b0f3732128ff: rpc.has_security_group_logging(os_id): False [ 827.611479] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.611730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.611730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.612059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.612289] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.612410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.612476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.612663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.612765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.612881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.613073] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.613202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.613289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.613397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.613566] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.613689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.613780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.613944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.614070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.614152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.614243] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.638180] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.638396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.706554] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.706687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.708273] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.711513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.712690] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.712837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.725744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.725845] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfefe395-d857-43f0-952f-7a8984da2f70 is going to be deleted. [ 827.726878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.727182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.746035] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 827.746267] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.746450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.746685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.747099] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.747099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.747263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.747338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.747419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.747508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.747675] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.747769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.747827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.747964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.748136] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.748227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.748287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.748425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.748498] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.748576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.748697] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.762195] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.762195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.763059] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.763174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.764369] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.764471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.776669] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f80555d1-ee88-4624-af40-5a9e62b1a6a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.785355] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.785588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.790539] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.790539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.820867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.821131] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45ed7e07-211b-423b-917e-bf729b9b3c70 is going to be deleted. [ 827.822455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.822755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.891534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.891727] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be deleted. [ 827.895605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.896057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.896325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.896478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fcdefb8-161e-4764-8a0f-9ca9a17b5bdd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.896867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.897095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.897229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.897534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5b58f96-24da-4b03-965a-558253f0ed7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.898495] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.898744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.898932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.899150] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.899469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.899688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.899828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.899979] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a already deleted. [ 827.900161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.900440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.900720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.900875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.901129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edac77c9-fa82-4dc9-b52a-a8a880305683" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.901366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.901636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.901775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.901950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5850b07-8815-476d-8023-18db057487e0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.902287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.903766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.903930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.904138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b9fef0a-8014-4d8e-9bd9-bf55d5312ccb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.904352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.904551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.904644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.904838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cda90900-060d-4f5f-a75d-9682dced28fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.905075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.905336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.944656] env[65553]: INFO networking_nsxv3.common.synchronization [req-8df106c1-8df0-4e01-973e-6899b83f7e3d req-4264ec43-c847-4f05-872b-a6e6d255ad96 tempest-ImagesTestJSON-1118693169 tempest-ImagesTestJSON-1118693169-project-member] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 827.946256] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 827.946256] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.946481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.946693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.947026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.947345] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.947695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.947695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.948462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.948754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.948924] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.022822] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.022822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.024140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.026525] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.026525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.026525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.026525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.026525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.026525] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 330e4cbb-c145-4a73-968c-26c6765a2388 is going to be updated. [ 828.027355] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.027677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.046491] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.046491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.116816] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a86c04db-ddf8-419d-8a90-125d10e637f6: rpc.has_security_group_logging(os_id): False [ 828.150394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.150853] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.151541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.151632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.151904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.151965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.152129] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 828.153301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.157030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.202041] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.202041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.211063] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.211063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.216137] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 in Status: SUCCESS [ 828.216338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.216516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.216758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.216954] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.217088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.217157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.217311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.217390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.217477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.217753] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('118c9912-ceb9-4aa1-bdf0-c6f83f3943b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.231743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.231947] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.232104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.232174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.232340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.232407] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.232509] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a is going to be updated. [ 828.233968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.234319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.252579] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f345373-ada8-463f-8791-7b6fdbbaba03: rpc.has_security_group_logging(os_id): False [ 828.282031] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.282031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.282031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.282031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.282031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.282031] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 is going to be created. [ 828.331311] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.331311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.332286] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.332391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.344708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.344708] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.344708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.344708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.344991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.344991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.345111] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.345111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.345198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.345318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.345386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.345647] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.345647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.345759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.345923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.347241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.347241] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 is going to be updated. [ 828.347398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.347702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.347794] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.348539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adbdb58c-5387-4b80-952f-8897a8d0f9c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.348709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.349119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.349195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.349328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfefe395-d857-43f0-952f-7a8984da2f70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.349507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.349659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.409055] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.409234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.409451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.409882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.409882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.447173] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.447534] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.447733] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.448123] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.448512] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.448773] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.448955] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.449327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.449895] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.449895] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.450133] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.450220] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.450372] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.450549] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.450719] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.450906] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.455366] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.458897] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 in Status: UNINITIALIZED for 2s [ 828.495362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.495865] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.496036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.496159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.496263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.496357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.496551] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.496663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.496726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.496890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.496964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.497222] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.497308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.497361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.497548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.497614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.497707] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 828.498869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.499047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.533629] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.534535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.564442] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.564641] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.114 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.564798] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.564957] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.565371] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-9d74c29a-60a1-411e-80a4-fee920cb4e5e taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.565562] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-9d74c29a-60a1-411e-80a4-fee920cb4e5e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.565682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-9d74c29a-60a1-411e-80a4-fee920cb4e5e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.566113] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-9d74c29a-60a1-411e-80a4-fee920cb4e5e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.566285] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d74c29a-60a1-411e-80a4-fee920cb4e5e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.595305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.595665] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.595878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.595972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.596202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.596431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.596431] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18b16119-4a62-4859-895e-b0f3732128ff is going to be updated. [ 828.597956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.598191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.624889] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.625230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.646770] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.647012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.705441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.706140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.706140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.706140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.706373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.706373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.706575] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.706691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.706847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.707081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.707121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.707293] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.707372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.707430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.707566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.707641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.707741] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 828.708961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.709201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.709341] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.710441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.710641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.719695] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.721147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.721147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.721147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.721147] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.721147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.721147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.721147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.721147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.721147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.721680] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.721680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.721680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.721680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.721840] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.721840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.721921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.722058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.722205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.722421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.722533] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('118c9912-ceb9-4aa1-bdf0-c6f83f3943b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.765435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.767084] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.767084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.767084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.768582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.768582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.768582] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.768582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.768582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.768582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.768582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.768582] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.770301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.770301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.770301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.770301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.770301] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 828.772064] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.772210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.772258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.772401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.772552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.773823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.773918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.774018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.774205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.774640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.775374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.775525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.776745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.776914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.777042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.777127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dea3d08e-2fb2-4e52-bb1b-a7e8a126eab9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.778963] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: IN_PROGRESS for 2s [ 828.778963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.778963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.778963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.779596] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.779749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.779880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.781190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.781352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.781442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.781543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45ed7e07-211b-423b-917e-bf729b9b3c70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.874706] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: IN_PROGRESS for 2s [ 828.875542] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: IN_PROGRESS for 2s [ 828.876470] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 828.889517] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.889662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.889734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.890038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.890255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.912252] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 828.939565] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18b16119-4a62-4859-895e-b0f3732128ff in Status: IN_PROGRESS for 2s [ 828.960379] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.993982] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.994211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.994211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.994459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.994629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.046675] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 829.068510] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 829.069325] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.069423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.069494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.069680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.069879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.071653] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.071908] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.072082] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.072382] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.072530] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.072688] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 9d74c29a-60a1-411e-80a4-fee920cb4e5e not found, creating... [ 829.072962] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.073383] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.073383] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.073499] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.073676] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.074023] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.074608] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.074767] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.074999] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.075163] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.075312] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 9d74c29a-60a1-411e-80a4-fee920cb4e5e is going to be created. [ 829.125618] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 829.137381] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.137850] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.137850] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.138566] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.138566] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.138761] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-9d74c29a-60a1-411e-80a4-fee920cb4e5e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.227922] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5: rpc.has_security_group_logging(os_id): False [ 829.312299] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.312590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.312590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.312922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.313050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.313354] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.313479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.313548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.313788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.313894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.314198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.314393] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.314467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.314636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.314741] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.315046] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.315189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.315276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.315477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.315581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.315696] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 is going to be created. [ 829.463208] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.463430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.463735] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.463853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.463904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.464149] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 829.497825] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.503374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.503627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.505904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.506185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.529454] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 in Status: IN_PROGRESS for 2s [ 829.581732] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.582038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.582038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.582460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.583071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.600556] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 829.867305] env[65553]: INFO networking_nsxv3.common.synchronization [req-8df106c1-8df0-4e01-973e-6899b83f7e3d req-7860056e-c29d-4905-9dc5-26c037901b8b service nova] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_rules [ 829.867305] env[65553]: INFO networking_nsxv3.common.synchronization [req-8df106c1-8df0-4e01-973e-6899b83f7e3d req-7860056e-c29d-4905-9dc5-26c037901b8b service nova] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 829.867305] env[65553]: INFO networking_nsxv3.common.synchronization [req-8df106c1-8df0-4e01-973e-6899b83f7e3d req-7860056e-c29d-4905-9dc5-26c037901b8b service nova] Enqueued Resource ID: 9d74c29a-60a1-411e-80a4-fee920cb4e5e with Priority: HIGHEST for action port [ 829.867857] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_rules [ 829.868221] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 829.868940] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d74c29a-60a1-411e-80a4-fee920cb4e5e with Priority: HIGHEST for action port [ 829.870614] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.870614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.870614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.870614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.870614] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.875358] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.875668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.877033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d74c29a-60a1-411e-80a4-fee920cb4e5e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.877033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d74c29a-60a1-411e-80a4-fee920cb4e5e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.877033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d74c29a-60a1-411e-80a4-fee920cb4e5e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.877348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d74c29a-60a1-411e-80a4-fee920cb4e5e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.877566] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d74c29a-60a1-411e-80a4-fee920cb4e5e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.381463] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.381463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.381463] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d74c29a-60a1-411e-80a4-fee920cb4e5e with status ACTIVE [ 830.381463] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.381463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.381463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.381463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.381463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.381463] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.381463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.381463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.381463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.381463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.381463] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.382923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.382923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.382923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.382923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.382923] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d74c29a-60a1-411e-80a4-fee920cb4e5e is going to be updated. [ 830.417584] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.417733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.417733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.418568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.418568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.418568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d74c29a-60a1-411e-80a4-fee920cb4e5e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.491478] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 in Status: SUCCESS [ 830.491988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.491988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.493678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.493678] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.493678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.493678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.493678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.493678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.493678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.493678] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f80555d1-ee88-4624-af40-5a9e62b1a6a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.805910] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: SUCCESS [ 830.805910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.903392] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: SUCCESS [ 830.903392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.903392] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 830.903392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.904148] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: SUCCESS [ 830.904408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.927475] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 830.927673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.957758] env[65553]: INFO networking_nsxv3.common.synchronization [req-5e73bb97-a1d9-4a42-838d-a3337330bea7 req-8aeb53df-b600-4bfc-9ccf-55006ac314e7 tempest-ServersAdminTestJSON-844759989 tempest-ServersAdminTestJSON-844759989-project-member] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 830.964501] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18b16119-4a62-4859-895e-b0f3732128ff in Status: SUCCESS [ 830.964627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.965274] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 830.965807] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.967727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.967727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.967727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.967727] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.967727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.967727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.967727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.967727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.967727] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.996058] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f80555d1-ee88-4624-af40-5a9e62b1a6a6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.996058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.996058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.996058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.996058] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.996058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.996058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.997977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.998162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.998279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.998502] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f80555d1-ee88-4624-af40-5a9e62b1a6a6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.998634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.999123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.999326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.999497] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.999596] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.999708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.999804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.999881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.999964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.000069] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f80555d1-ee88-4624-af40-5a9e62b1a6a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.065770] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 831.066171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.066425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.066698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.066867] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.143413] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 831.143413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.143413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.143413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.143413] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.471025] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.503081] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f80555d1-ee88-4624-af40-5a9e62b1a6a6: rpc.has_security_group_logging(os_id): False [ 831.526430] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.526967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.527194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.527571] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.529026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.529026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.529026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.529026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.529026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.529026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.529026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.529026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.529026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.529646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.529882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.530303] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.531131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.531575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.533237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.533237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.533237] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 is going to be created. [ 831.539566] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.540124] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.540610] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.541817] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.542304] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.542523] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.542662] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.543121] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.543121] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.543329] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.543451] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.543903] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.543903] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.543903] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.543903] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.544153] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.547614] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 in Status: SUCCESS [ 831.547784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.570010] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.570355] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 831.570603] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.570916] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.571450] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-ff144313-7a12-4f51-98a2-b8d9723bd8af taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.571771] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-ff144313-7a12-4f51-98a2-b8d9723bd8af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.572014] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-ff144313-7a12-4f51-98a2-b8d9723bd8af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.572521] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-ff144313-7a12-4f51-98a2-b8d9723bd8af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.572767] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff144313-7a12-4f51-98a2-b8d9723bd8af',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.574245] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.574443] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.574581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.574889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.576124] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.576124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.576124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.576124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.576347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.576347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.576484] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.612194] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.612347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.612418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.612637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.612819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.614851] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 831.615275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.615570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.615831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.616035] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.616160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.616229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.616408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.616491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.616585] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.627043] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 in Status: IN_PROGRESS for 2s [ 831.646635] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.646834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.646920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.647176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.647382] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.647488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.647566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.647705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.647827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.647944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.648064] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.974189] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.078805] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.079108] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.079265] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.079589] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.079787] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.080305] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port ff144313-7a12-4f51-98a2-b8d9723bd8af not found, creating... [ 832.080359] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.080570] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.080640] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.080903] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.081340] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.081717] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.081876] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.081995] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.082266] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.082440] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.082633] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: ff144313-7a12-4f51-98a2-b8d9723bd8af is going to be created. [ 832.084138] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.084288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.084366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.084547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.084717] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.084925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.085055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.085215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.085708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.085835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.086071] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.086202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.086274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.086475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.086603] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.086724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.086867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.086955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.087054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.087141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.087251] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.114316] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.114608] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.114700] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.114928] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.115190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.115422] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-ff144313-7a12-4f51-98a2-b8d9723bd8af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.119503] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.150977] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.151294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.151463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.151849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.152220] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.152392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.152517] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.152733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.152832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.152923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.153143] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.153241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.153346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.153489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.153632] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.153832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.153895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.154095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.154174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.154256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.154355] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.477627] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.477841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.477959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.478313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.478313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.478450] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 832.516088] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.516304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.516409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.516718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.516992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.527958] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 832.590132] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a86c04db-ddf8-419d-8a90-125d10e637f6: rpc.has_security_group_logging(os_id): False [ 832.620370] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.620606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.620606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.620809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.620919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.621154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.621256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.621316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.621496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.621661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.621864] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.621958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.622024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.622170] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.622247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.622445] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.622566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.622626] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.622765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.622841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.622890] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 832.624106] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.659642] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f345373-ada8-463f-8791-7b6fdbbaba03: rpc.has_security_group_logging(os_id): False [ 832.688650] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.689231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.689231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.689370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.689468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.689745] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.689848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.690323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.692062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.692185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.692420] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.692862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.692862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.692862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.693020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.693174] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.693320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.693770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.694141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.694215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.694347] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 832.741123] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.741123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.741123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.741123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.741123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.768802] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 832.784427] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.784687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.784687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.784973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.785108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.822661] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 832.883948] env[65553]: INFO networking_nsxv3.common.synchronization [req-5e73bb97-a1d9-4a42-838d-a3337330bea7 req-503d9906-3594-44c7-89b0-c35d8721612e service nova] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_rules [ 832.884152] env[65553]: INFO networking_nsxv3.common.synchronization [req-5e73bb97-a1d9-4a42-838d-a3337330bea7 req-503d9906-3594-44c7-89b0-c35d8721612e service nova] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 832.885053] env[65553]: INFO networking_nsxv3.common.synchronization [req-5e73bb97-a1d9-4a42-838d-a3337330bea7 req-503d9906-3594-44c7-89b0-c35d8721612e service nova] Enqueued Resource ID: ff144313-7a12-4f51-98a2-b8d9723bd8af with Priority: HIGHEST for action port [ 832.885053] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_rules [ 832.885705] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 832.885847] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff144313-7a12-4f51-98a2-b8d9723bd8af with Priority: HIGHEST for action port [ 832.886205] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.886340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.886404] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.886641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.886737] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.894037] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.894037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.894348] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff144313-7a12-4f51-98a2-b8d9723bd8af taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.894464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff144313-7a12-4f51-98a2-b8d9723bd8af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.894527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff144313-7a12-4f51-98a2-b8d9723bd8af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.894733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff144313-7a12-4f51-98a2-b8d9723bd8af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.895151] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff144313-7a12-4f51-98a2-b8d9723bd8af',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.128464] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.128873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.128873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.129186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.129331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.129473] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 833.170908] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.170908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.170908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.170908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.170908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.180180] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 833.400030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.400030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.400030] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff144313-7a12-4f51-98a2-b8d9723bd8af with status ACTIVE [ 833.400030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.400030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.400030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.400030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.400030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.400030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.400030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.400030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.400030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.400030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.400030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.401021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.401021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.401021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.401021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.401021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff144313-7a12-4f51-98a2-b8d9723bd8af is going to be updated. [ 833.431419] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.431419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.431671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.432065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.432153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.433080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff144313-7a12-4f51-98a2-b8d9723bd8af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.641667] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 in Status: SUCCESS [ 833.641667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.543579] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 834.543922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.545404] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.545907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.546061] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.546229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.546564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.546564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.546658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.546798] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.550046] env[65553]: INFO networking_nsxv3.common.synchronization [None req-576ca3f9-e079-47bb-b397-5d7a688f296f None None] Enqueued Resource ID: 87078d91-e9f5-46ef-88fe-1c319e7e5926 with Priority: HIGHEST for action port [ 834.550871] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87078d91-e9f5-46ef-88fe-1c319e7e5926 with Priority: HIGHEST for action port [ 834.551402] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-87078d91-e9f5-46ef-88fe-1c319e7e5926 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.552795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87078d91-e9f5-46ef-88fe-1c319e7e5926" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.552795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87078d91-e9f5-46ef-88fe-1c319e7e5926" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.552795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87078d91-e9f5-46ef-88fe-1c319e7e5926" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.552795] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87078d91-e9f5-46ef-88fe-1c319e7e5926',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.787113] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 834.787113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.841197] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 834.841459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.841703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.841967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.842308] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.051448] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.059327] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87078d91-e9f5-46ef-88fe-1c319e7e5926 [ 835.059327] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.059327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.059327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.059808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.059902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.060023] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87078d91-e9f5-46ef-88fe-1c319e7e5926 already deleted. [ 835.060116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87078d91-e9f5-46ef-88fe-1c319e7e5926" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.199249] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 835.199249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.199249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.199249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.199249] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.199249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.199249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.199249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.199249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.199249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.199249] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.347364] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.347364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.347364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.347364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.347364] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.347364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.347364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.347364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.347364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.347744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.347744] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.559334] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.709316] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.709316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.709447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.709582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.709827] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.709916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.709916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.711286] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.711286] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.711286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.711286] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.851367] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.851521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.851590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.851810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.852390] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.852493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.852557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.852699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.852777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.852862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.853025] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.853106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.853167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.853284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.853412] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.856340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.856414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.856642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.856737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.856831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.856924] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.061816] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.061987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.062146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.064385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.064385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.064385] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 836.099867] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.100020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.100071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.102560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.102560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.113448] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 836.176217] env[65553]: INFO networking_nsxv3.common.synchronization [None req-49f8eda7-8a53-4d3e-90ab-5185cbe39901 tempest-ImagesOneServerNegativeTestJSON-967710394 tempest-ImagesOneServerNegativeTestJSON-967710394-project-member] Enqueued Resource ID: 48937242-2e21-4b3c-884b-9d6b6826e52a with Priority: HIGHEST for action security_group_rules [ 836.176729] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48937242-2e21-4b3c-884b-9d6b6826e52a with Priority: HIGHEST for action security_group_rules [ 836.177298] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48937242-2e21-4b3c-884b-9d6b6826e52a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.177491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48937242-2e21-4b3c-884b-9d6b6826e52a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.177607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48937242-2e21-4b3c-884b-9d6b6826e52a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.178227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48937242-2e21-4b3c-884b-9d6b6826e52a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.178227] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48937242-2e21-4b3c-884b-9d6b6826e52a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.215246] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15032a54-f6e7-41b8-855b-0262e8fb39c5: rpc.has_security_group_logging(os_id): False [ 836.236410] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.236410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.236410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.236608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.279484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.279986] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.279986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.281684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.281684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.281684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.281684] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.281684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.282321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.283461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.283461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.283590] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.283674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.283737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.283956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.284216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.284216] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 836.362236] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f345373-ada8-463f-8791-7b6fdbbaba03: rpc.has_security_group_logging(os_id): False [ 836.382712] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.382990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.383204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.383555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.383953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.396020] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.396309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.396501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.396701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.396858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.397152] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.397258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.397311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.397507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.397575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.397771] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.397868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.397921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.398072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.398152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.398361] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.398449] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.398503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.398652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.398726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.398788] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 836.404670] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 836.472105] env[65553]: INFO networking_nsxv3.common.synchronization [None req-9e2c394d-819e-42d8-b19b-6ae243f62770 tempest-ImagesOneServerNegativeTestJSON-967710394 tempest-ImagesOneServerNegativeTestJSON-967710394-project-member] Enqueued Resource ID: 48937242-2e21-4b3c-884b-9d6b6826e52a with Priority: HIGHEST for action security_group_rules [ 836.472737] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48937242-2e21-4b3c-884b-9d6b6826e52a with Priority: HIGHEST for action security_group_rules [ 836.473030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48937242-2e21-4b3c-884b-9d6b6826e52a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.473103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48937242-2e21-4b3c-884b-9d6b6826e52a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.482685] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.482911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.482911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.483207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.483356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.546309] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 836.705446] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.705446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.705446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.705446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.705446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.705446] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48937242-2e21-4b3c-884b-9d6b6826e52a already deleted. [ 836.705446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48937242-2e21-4b3c-884b-9d6b6826e52a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.705446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48937242-2e21-4b3c-884b-9d6b6826e52a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.705446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48937242-2e21-4b3c-884b-9d6b6826e52a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.705446] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48937242-2e21-4b3c-884b-9d6b6826e52a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.790707] env[65553]: INFO networking_nsxv3.common.synchronization [req-c397b027-37af-4182-8c52-db94c92cfa16 req-f198408b-b959-4aff-b9b7-114f942da764 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_members [ 836.790935] env[65553]: INFO networking_nsxv3.common.synchronization [req-c397b027-37af-4182-8c52-db94c92cfa16 req-f198408b-b959-4aff-b9b7-114f942da764 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 836.791956] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_members [ 836.792236] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 836.792616] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-354651da-2fa6-41a7-a3bb-8655872e6da5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.792771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.792919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.793153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.793338] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.793447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.793531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.793761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.793857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.793979] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.796661] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.796661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.796661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.796661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.798685] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.798685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.798685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.798685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.798685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.798685] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.850016] env[65553]: INFO networking_nsxv3.common.synchronization [req-c397b027-37af-4182-8c52-db94c92cfa16 req-f198408b-b959-4aff-b9b7-114f942da764 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_rules [ 836.850323] env[65553]: INFO networking_nsxv3.common.synchronization [req-c397b027-37af-4182-8c52-db94c92cfa16 req-f198408b-b959-4aff-b9b7-114f942da764 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_members [ 836.850548] env[65553]: INFO networking_nsxv3.common.synchronization [req-c397b027-37af-4182-8c52-db94c92cfa16 req-f198408b-b959-4aff-b9b7-114f942da764 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 836.850712] env[65553]: INFO networking_nsxv3.common.synchronization [req-c397b027-37af-4182-8c52-db94c92cfa16 req-f198408b-b959-4aff-b9b7-114f942da764 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 836.850881] env[65553]: INFO networking_nsxv3.common.synchronization [req-c397b027-37af-4182-8c52-db94c92cfa16 req-f198408b-b959-4aff-b9b7-114f942da764 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 96fae0e6-21a3-4592-8d8f-69a1e877b050 with Priority: HIGHEST for action port [ 836.851597] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_rules [ 836.851744] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 836.851832] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96fae0e6-21a3-4592-8d8f-69a1e877b050 with Priority: HIGHEST for action port [ 836.851916] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_members [ 836.851994] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 836.852342] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-354651da-2fa6-41a7-a3bb-8655872e6da5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.852578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.852578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.852805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.852893] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.855586] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.855586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.855586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.855586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.855586] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.855882] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-96fae0e6-21a3-4592-8d8f-69a1e877b050 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.856198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.856198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.856382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.856517] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96fae0e6-21a3-4592-8d8f-69a1e877b050',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.857874] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-354651da-2fa6-41a7-a3bb-8655872e6da5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.858043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.858683] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.858818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.234525] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.234701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.234778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.234991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.236145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.236145] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48937242-2e21-4b3c-884b-9d6b6826e52a already deleted. [ 837.236145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48937242-2e21-4b3c-884b-9d6b6826e52a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.302529] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.307290] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.360960] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.361284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.361644] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-354651da-2fa6-41a7-a3bb-8655872e6da5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.361751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.364820] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96fae0e6-21a3-4592-8d8f-69a1e877b050 with status ACTIVE [ 837.365145] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.365863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.366606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.366880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.367048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.367271] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.367416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.367501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.367661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.367744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.367969] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.368112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.368184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.368339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.368426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.368520] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96fae0e6-21a3-4592-8d8f-69a1e877b050 is going to be updated. [ 837.416373] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.416677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.416677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.416826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.416984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.417183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.806436] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.811125] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.059066] env[65553]: INFO networking_nsxv3.common.synchronization [None req-e5029f04-d671-4fa5-b440-91e95f8a3817 None None] Enqueued Resource ID: cf0fd0af-96d2-427f-b763-9e36ee533578 with Priority: HIGHEST for action port [ 838.059710] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf0fd0af-96d2-427f-b763-9e36ee533578 with Priority: HIGHEST for action port [ 838.063515] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf0fd0af-96d2-427f-b763-9e36ee533578 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.064493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf0fd0af-96d2-427f-b763-9e36ee533578" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.064641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf0fd0af-96d2-427f-b763-9e36ee533578" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.064935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf0fd0af-96d2-427f-b763-9e36ee533578" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.065049] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf0fd0af-96d2-427f-b763-9e36ee533578',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.125355] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 838.125586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.125762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.126184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.126388] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.126507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.126573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.127092] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.127092] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.127262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.127262] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.308815] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.309034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.309099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.309294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.309375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.309480] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 is going to be created. [ 838.310967] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.311098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.311209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.311360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.311443] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.311536] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 838.346297] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.346297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.347051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.347051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.347051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.349807] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.349953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.350047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.351539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.351539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.363287] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 838.366626] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: UNINITIALIZED for 2s [ 838.427228] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 838.427228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.567927] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf0fd0af-96d2-427f-b763-9e36ee533578 [ 838.568283] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.568490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.568562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.568818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.568880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.569073] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf0fd0af-96d2-427f-b763-9e36ee533578 already deleted. [ 838.569157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf0fd0af-96d2-427f-b763-9e36ee533578" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.577192] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 838.577490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.630332] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.630564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.630701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.630871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.631176] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.631356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.631356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.631701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.631701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.631701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.631865] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.631865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.631865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.631865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.632450] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.632734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.632734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.632734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.632840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.633106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.633106] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.648661] env[65553]: INFO networking_nsxv3.common.synchronization [req-b9c2b4a4-3e0d-4cef-baee-80d984db0553 req-1d20b1dc-ebcb-4ff6-b768-de479cadbf24 tempest-MultipleCreateTestJSON-1937935220 tempest-MultipleCreateTestJSON-1937935220-project-member] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 838.649947] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 838.650556] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.650780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.650874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.651118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.651401] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.651536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.651628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.651824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.652246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.652246] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.015427] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d21d9ec9-641a-4dc8-8de0-1232c4b7c735 None None] Enqueued Resource ID: e01e280d-3e44-4119-8c0d-46ede51c60af with Priority: HIGHEST for action port [ 839.015728] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01e280d-3e44-4119-8c0d-46ede51c60af with Priority: HIGHEST for action port [ 839.017134] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e01e280d-3e44-4119-8c0d-46ede51c60af taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.017134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e01e280d-3e44-4119-8c0d-46ede51c60af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.017134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e01e280d-3e44-4119-8c0d-46ede51c60af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.017134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e01e280d-3e44-4119-8c0d-46ede51c60af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.017134] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e01e280d-3e44-4119-8c0d-46ede51c60af',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.136474] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c96c798-8819-41b0-9168-410c415c2391: rpc.has_security_group_logging(os_id): False [ 839.154242] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.167162] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.167162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.167162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.167162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.167162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.167469] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.167532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.167638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.167786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.168136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.168211] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.169462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.169462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.169555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.169608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.172061] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.172061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.172061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.172061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.172061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.172061] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 839.278542] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.278761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.278833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.279128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.279590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.308385] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 839.523920] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e01e280d-3e44-4119-8c0d-46ede51c60af [ 839.524358] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.524358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.524769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.524828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.524881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.525190] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e01e280d-3e44-4119-8c0d-46ede51c60af already deleted. [ 839.525190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e01e280d-3e44-4119-8c0d-46ede51c60af" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.659150] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.840950] env[65553]: INFO networking_nsxv3.common.synchronization [req-11fb02ab-92eb-4e11-8d7e-4c5da14241be req-ded61173-ed31-4bb4-b197-3b942d5076b3 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_members [ 839.845643] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_members [ 839.845643] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-424e0166-59a6-441d-abf8-1fa9f2584819 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.845643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.845643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.845643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.845643] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.845643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.845643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.845643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.846336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.846336] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.162480] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.162891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.162891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.163233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.163332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.163487] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 840.234708] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.234708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.234708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.234708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.234708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.255833] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 840.348738] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.348968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.348968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.349234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.349325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.349547] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.349736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.350015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.350015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.350145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.350185] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 424e0166-59a6-441d-abf8-1fa9f2584819 already deleted. [ 840.350273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.383029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 840.383029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.383029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: SUCCESS [ 840.383029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.383029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.383029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.383029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.383029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.383029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.383029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.383029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.383029] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.385549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.387456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.387817] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.394559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.394559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.394559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.394559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.394559] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.394559] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.394559] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.394559] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.394559] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.394559] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.396706] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.402311] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.402862] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.403241] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.403649] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.403895] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.404135] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.404349] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.404565] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.405716] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.406114] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.412339] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.440919] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.442129] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 840.442129] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.444281] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.444281] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-3641e489-4292-4aa7-8458-2580a75688c1 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.444281] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-3641e489-4292-4aa7-8458-2580a75688c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.444281] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-3641e489-4292-4aa7-8458-2580a75688c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.444281] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-3641e489-4292-4aa7-8458-2580a75688c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.444281] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3641e489-4292-4aa7-8458-2580a75688c1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.892656] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.915697] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.946448] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.946787] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.946954] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.947276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.947455] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.947612] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 3641e489-4292-4aa7-8458-2580a75688c1 not found, creating... [ 840.947995] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.948184] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.948331] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.948616] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.948753] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.949391] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.950606] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.950606] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.950744] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.951011] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.951152] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 3641e489-4292-4aa7-8458-2580a75688c1 is going to be created. [ 840.974954] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.975264] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.975387] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.975750] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.976070] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.976383] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-3641e489-4292-4aa7-8458-2580a75688c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.341721] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 841.342048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.400446] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.418667] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.418667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.418667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.419565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.419565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.419669] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 is going to be updated. [ 841.452856] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.453135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.453135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.453315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.453640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.474051] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: IN_PROGRESS for 2s [ 841.719115] env[65553]: INFO networking_nsxv3.common.synchronization [req-181c2acd-acdb-4d99-811c-78b1e8449b5f req-0e50a074-b723-45b7-8a64-a6a45be5c091 tempest-MultipleCreateTestJSON-1937935220 tempest-MultipleCreateTestJSON-1937935220-project-member] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 841.719552] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGHEST for action security_group_members [ 841.720136] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.720136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.852484] env[65553]: INFO networking_nsxv3.common.synchronization [req-11fb02ab-92eb-4e11-8d7e-4c5da14241be req-754545ba-3358-4c03-b496-91451690e5eb service nova] Enqueued Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_rules [ 841.852759] env[65553]: INFO networking_nsxv3.common.synchronization [req-11fb02ab-92eb-4e11-8d7e-4c5da14241be req-754545ba-3358-4c03-b496-91451690e5eb service nova] Enqueued Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_members [ 841.852759] env[65553]: INFO networking_nsxv3.common.synchronization [req-11fb02ab-92eb-4e11-8d7e-4c5da14241be req-754545ba-3358-4c03-b496-91451690e5eb service nova] Enqueued Resource ID: 3641e489-4292-4aa7-8458-2580a75688c1 with Priority: HIGHEST for action port [ 841.854174] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_rules [ 841.854174] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_members [ 841.854174] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3641e489-4292-4aa7-8458-2580a75688c1 with Priority: HIGHEST for action port [ 841.854174] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-424e0166-59a6-441d-abf8-1fa9f2584819 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.854174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.854174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.854441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.854441] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.855434] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-424e0166-59a6-441d-abf8-1fa9f2584819 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.856459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.856459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.856459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.856459] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.856459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.856459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.856459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.856459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.856982] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.857760] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-3641e489-4292-4aa7-8458-2580a75688c1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.857868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3641e489-4292-4aa7-8458-2580a75688c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.858110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3641e489-4292-4aa7-8458-2580a75688c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.858276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3641e489-4292-4aa7-8458-2580a75688c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.858382] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3641e489-4292-4aa7-8458-2580a75688c1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.905032] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.905439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.905439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.905667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.906858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.906858] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 841.941705] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.941903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.941966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.942202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.942353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.954359] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 842.264609] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 842.264609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.264609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.269245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.269245] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.269245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.269245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.269245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.269245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.269245] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.361638] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-424e0166-59a6-441d-abf8-1fa9f2584819 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.361953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.361994] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.363280] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3641e489-4292-4aa7-8458-2580a75688c1 with status ACTIVE [ 842.363955] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.363955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.363955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.363955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.363955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.364242] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.364242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.364242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.364456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.364539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.364707] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.364825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.364825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.364988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.364988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.366269] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3641e489-4292-4aa7-8458-2580a75688c1 is going to be updated. [ 842.394905] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.395122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.395173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.395368] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.395496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.395658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3641e489-4292-4aa7-8458-2580a75688c1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.771297] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.771506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.771506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.771696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.771776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.772017] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.772160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.772234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.772490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.772490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.772490] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be updated. [ 842.822461] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.822640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.822696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.822973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.823128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.837381] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: IN_PROGRESS for 2s [ 842.869013] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.241954] env[65553]: INFO networking_nsxv3.common.synchronization [None req-c41776b4-bce6-4590-b8d5-2e056463ce87 None None] Enqueued Resource ID: 23ca7b86-3771-4591-9005-736d91dc491b with Priority: HIGHEST for action port [ 843.244426] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23ca7b86-3771-4591-9005-736d91dc491b with Priority: HIGHEST for action port [ 843.245135] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-23ca7b86-3771-4591-9005-736d91dc491b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.245328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23ca7b86-3771-4591-9005-736d91dc491b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.245328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23ca7b86-3771-4591-9005-736d91dc491b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.245619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23ca7b86-3771-4591-9005-736d91dc491b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.245698] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23ca7b86-3771-4591-9005-736d91dc491b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.375744] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.375744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.375744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.375744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.375744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.375744] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 424e0166-59a6-441d-abf8-1fa9f2584819 is going to be created. [ 843.404902] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.404902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.404902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.404902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.404902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.424348] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 424e0166-59a6-441d-abf8-1fa9f2584819 in Status: UNINITIALIZED for 2s [ 843.482490] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: SUCCESS [ 843.484071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.484540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.484540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.487085] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.487085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.487085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.487085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.487085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.487085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.487085] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.748849] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23ca7b86-3771-4591-9005-736d91dc491b [ 843.749126] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.749262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.749338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.749634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.749724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.752019] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23ca7b86-3771-4591-9005-736d91dc491b already deleted. [ 843.752019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23ca7b86-3771-4591-9005-736d91dc491b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.969651] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 843.969938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.970216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.970508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.970788] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.971034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.971097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.971295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.971403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.974871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.975213] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.992049] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.485359] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.485946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.485946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.485946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.486191] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.486191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.486334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.486413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.486477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.486527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.486683] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.486770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.486828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.486993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.487145] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.487250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.487326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.487419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.487503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.487586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.487674] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.495109] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 354651da-2fa6-41a7-a3bb-8655872e6da5: rpc.has_security_group_logging(os_id): False [ 844.521432] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.522331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.522469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.522619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.522692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.522953] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.523413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.523413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.523413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.523413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.523634] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 is going to be created. [ 844.634680] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.634848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.634848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.635138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.635217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.669741] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: IN_PROGRESS for 2s [ 844.849266] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 in Status: SUCCESS [ 844.849266] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 deletion is rescheduled due to dependency. [ 844.849266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.991480] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a86c04db-ddf8-419d-8a90-125d10e637f6: rpc.has_security_group_logging(os_id): False [ 845.012331] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.013184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.013184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.013184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.013184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.013184] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.013184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.013512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.013512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.013512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.013653] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.013751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.013880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.014082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.014483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.014483] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.014483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.014707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.014707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.014819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.014819] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 845.112730] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.112901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.112968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.113217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.113380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.133152] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 845.435982] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 424e0166-59a6-441d-abf8-1fa9f2584819 in Status: SUCCESS [ 845.436809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.436809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.437313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.438081] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.440275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.440275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.440275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.440275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.440275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.440275] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.876774] env[65553]: INFO networking_nsxv3.common.synchronization [None req-21c75003-b85c-454b-8bc8-c40a08184e26 None None] Enqueued Resource ID: 0f52fc92-36f4-4553-8444-7975eea32f14 with Priority: HIGHEST for action port [ 845.877395] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f52fc92-36f4-4553-8444-7975eea32f14 with Priority: HIGHEST for action port [ 845.877707] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f52fc92-36f4-4553-8444-7975eea32f14 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.877827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f52fc92-36f4-4553-8444-7975eea32f14" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.877896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f52fc92-36f4-4553-8444-7975eea32f14" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.878274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f52fc92-36f4-4553-8444-7975eea32f14" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.878364] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f52fc92-36f4-4553-8444-7975eea32f14',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.906944] env[65553]: INFO networking_nsxv3.common.synchronization [req-a776f6b6-0b37-4a65-ada1-6b4f7e655e29 req-b9c1755e-9ba6-419c-8ad3-3ed2180c2f74 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_members [ 845.907200] env[65553]: INFO networking_nsxv3.common.synchronization [req-a776f6b6-0b37-4a65-ada1-6b4f7e655e29 req-b9c1755e-9ba6-419c-8ad3-3ed2180c2f74 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 with Priority: HIGHEST for action security_group_members [ 845.907415] env[65553]: INFO networking_nsxv3.common.synchronization [req-a776f6b6-0b37-4a65-ada1-6b4f7e655e29 req-b9c1755e-9ba6-419c-8ad3-3ed2180c2f74 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 845.909853] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_members [ 845.910118] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 with Priority: HIGHEST for action security_group_members [ 845.910286] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 845.911495] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-354651da-2fa6-41a7-a3bb-8655872e6da5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.911667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.911769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.912070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.912297] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.912438] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.912548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.912764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.912884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.915939] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.917449] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-65313ec8-b8c4-4906-8f60-f1a528eb15a0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.917627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.917733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.919249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.919473] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.920008] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.920115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.920340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.920462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.920594] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65313ec8-b8c4-4906-8f60-f1a528eb15a0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.922356] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.922602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.923381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.923709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.924394] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.924551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.924663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.924925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.926124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.926732] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.933195] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65313ec8-b8c4-4906-8f60-f1a528eb15a0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.934092] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.945557] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.968183] env[65553]: INFO networking_nsxv3.common.synchronization [req-a776f6b6-0b37-4a65-ada1-6b4f7e655e29 req-b9c1755e-9ba6-419c-8ad3-3ed2180c2f74 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_rules [ 845.968378] env[65553]: INFO networking_nsxv3.common.synchronization [req-a776f6b6-0b37-4a65-ada1-6b4f7e655e29 req-b9c1755e-9ba6-419c-8ad3-3ed2180c2f74 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_members [ 845.968532] env[65553]: INFO networking_nsxv3.common.synchronization [req-a776f6b6-0b37-4a65-ada1-6b4f7e655e29 req-b9c1755e-9ba6-419c-8ad3-3ed2180c2f74 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 with Priority: HIGHEST for action security_group_rules [ 845.968676] env[65553]: INFO networking_nsxv3.common.synchronization [req-a776f6b6-0b37-4a65-ada1-6b4f7e655e29 req-b9c1755e-9ba6-419c-8ad3-3ed2180c2f74 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 with Priority: HIGHEST for action security_group_members [ 845.968802] env[65553]: INFO networking_nsxv3.common.synchronization [req-a776f6b6-0b37-4a65-ada1-6b4f7e655e29 req-b9c1755e-9ba6-419c-8ad3-3ed2180c2f74 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 845.968924] env[65553]: INFO networking_nsxv3.common.synchronization [req-a776f6b6-0b37-4a65-ada1-6b4f7e655e29 req-b9c1755e-9ba6-419c-8ad3-3ed2180c2f74 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 845.969112] env[65553]: INFO networking_nsxv3.common.synchronization [req-a776f6b6-0b37-4a65-ada1-6b4f7e655e29 req-b9c1755e-9ba6-419c-8ad3-3ed2180c2f74 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 96fae0e6-21a3-4592-8d8f-69a1e877b050 with Priority: HIGHEST for action port [ 845.972291] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_rules [ 845.972440] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 with Priority: HIGHEST for action security_group_rules [ 845.972541] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 845.972637] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96fae0e6-21a3-4592-8d8f-69a1e877b050 with Priority: HIGHEST for action port [ 845.972730] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_rules [ 845.972817] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_members [ 845.972905] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 with Priority: HIGHEST for action security_group_members [ 845.973239] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-354651da-2fa6-41a7-a3bb-8655872e6da5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.973347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.973551] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65313ec8-b8c4-4906-8f60-f1a528eb15a0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.973655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.973716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.974104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.974182] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65313ec8-b8c4-4906-8f60-f1a528eb15a0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.975280] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.975280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.975491] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-96fae0e6-21a3-4592-8d8f-69a1e877b050 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.975592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.975654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.979696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.979696] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96fae0e6-21a3-4592-8d8f-69a1e877b050',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.979696] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.979696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.979696] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-354651da-2fa6-41a7-a3bb-8655872e6da5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.979696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.979696] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-65313ec8-b8c4-4906-8f60-f1a528eb15a0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.979696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.381033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f52fc92-36f4-4553-8444-7975eea32f14 [ 846.381033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.381033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.381274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.381312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.383115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.383115] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f52fc92-36f4-4553-8444-7975eea32f14 already deleted. [ 846.383115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f52fc92-36f4-4553-8444-7975eea32f14" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.436328] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.437349] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.438190] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65313ec8-b8c4-4906-8f60-f1a528eb15a0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.451060] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 424e0166-59a6-441d-abf8-1fa9f2584819: rpc.has_security_group_logging(os_id): False [ 846.476072] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.477726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.477726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.477726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.477726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.477726] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.477726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.477726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.477726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.478102] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.478102] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 424e0166-59a6-441d-abf8-1fa9f2584819 is going to be created. [ 846.480214] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96fae0e6-21a3-4592-8d8f-69a1e877b050 with status ACTIVE [ 846.480466] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.480615] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.480654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.480826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.480925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.481152] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.481255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.481382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.481849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.481849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.481960] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.482122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.482270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.482415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.483169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.483169] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96fae0e6-21a3-4592-8d8f-69a1e877b050 is going to be updated. [ 846.484186] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-65313ec8-b8c4-4906-8f60-f1a528eb15a0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.484664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.517329] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.517520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.517616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.517913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.518231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.519033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96fae0e6-21a3-4592-8d8f-69a1e877b050" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.610796] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.611911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.612046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.612298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.612540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.635774] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 424e0166-59a6-441d-abf8-1fa9f2584819 in Status: IN_PROGRESS for 2s [ 846.709080] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: SUCCESS [ 846.709234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.709339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.709573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.709664] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.719273] env[65553]: INFO networking_nsxv3.common.synchronization [req-ef56dbbb-95e3-4db3-867f-fb218161d2b0 req-f75bc050-1fe0-44ff-847d-5f7a395954f3 tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_members [ 846.721556] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_members [ 846.721556] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-76312788-a044-46c4-912d-a43bc9c8e59f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.721556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.721866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.721866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.722335] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.722335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.722335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.722580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.722580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.722580] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76312788-a044-46c4-912d-a43bc9c8e59f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.943627] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.944042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.944042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.944166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.944166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.944276] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 is going to be updated. [ 846.945450] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.946767] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.946767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.946767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.947339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.947339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.947339] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 is going to be created. [ 846.978413] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.978413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.978413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.978413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.978413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.985683] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.985983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.986124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.986433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.986625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.995523] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 in Status: UNINITIALIZED for 2s [ 846.996870] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: IN_PROGRESS for 2s [ 847.122980] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.123182] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.123299] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.123553] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.123894] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.125956] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.126128] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.126374] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.126539] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.126747] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.126911] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.127047] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.127193] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.127253] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.127360] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.127488] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.147977] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 847.148220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.148390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.148597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.148678] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.153360] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.153516] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 847.153647] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.153810] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.154130] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-01223b61-c661-4233-929d-e668abe84077 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.154299] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-01223b61-c661-4233-929d-e668abe84077" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.154409] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-01223b61-c661-4233-929d-e668abe84077" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.154730] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-01223b61-c661-4233-929d-e668abe84077" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.154859] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01223b61-c661-4233-929d-e668abe84077',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.221568] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-354651da-2fa6-41a7-a3bb-8655872e6da5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.221720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.228012] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.228809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.228892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.229130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.229216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.229580] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.229688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.229688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.229832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.229910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.230020] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76312788-a044-46c4-912d-a43bc9c8e59f already deleted. [ 847.230079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.452087] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.452243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.452325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.452506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.452595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.452692] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 847.485401] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.485594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.485742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.486583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.486583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.497567] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 847.653247] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.653247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.658447] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.658447] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.658447] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.658779] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.659378] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.659378] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 01223b61-c661-4233-929d-e668abe84077 not found, creating... [ 847.659378] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.659574] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.659669] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.659884] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.660035] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.660324] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.660518] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.661407] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.661585] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.661821] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.661978] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 01223b61-c661-4233-929d-e668abe84077 is going to be created. [ 847.684080] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.684356] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.684511] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.684860] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.685607] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.685607] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-01223b61-c661-4233-929d-e668abe84077" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.116947] env[65553]: INFO networking_nsxv3.common.synchronization [req-24915bd8-3ede-48a9-991d-286d4cccbf21 req-ab1d2e08-1b1e-4464-a51e-6879471a55dd tempest-InstanceActionsTestJSON-1420156515 tempest-InstanceActionsTestJSON-1420156515-project-member] Enqueued Resource ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 with Priority: HIGHEST for action security_group_members [ 848.117571] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 with Priority: HIGHEST for action security_group_members [ 848.117876] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.118010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.118077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.118272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.118426] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.118525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.118587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.118730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.118809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.118904] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('118c9912-ceb9-4aa1-bdf0-c6f83f3943b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.445540] env[65553]: INFO networking_nsxv3.common.synchronization [req-ef56dbbb-95e3-4db3-867f-fb218161d2b0 req-01df775b-accf-4731-819c-b0a0fc9285d1 service nova] Enqueued Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_rules [ 848.445844] env[65553]: INFO networking_nsxv3.common.synchronization [req-ef56dbbb-95e3-4db3-867f-fb218161d2b0 req-01df775b-accf-4731-819c-b0a0fc9285d1 service nova] Enqueued Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_members [ 848.446337] env[65553]: INFO networking_nsxv3.common.synchronization [req-ef56dbbb-95e3-4db3-867f-fb218161d2b0 req-01df775b-accf-4731-819c-b0a0fc9285d1 service nova] Enqueued Resource ID: 01223b61-c661-4233-929d-e668abe84077 with Priority: HIGHEST for action port [ 848.447964] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_rules [ 848.447964] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_members [ 848.448482] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01223b61-c661-4233-929d-e668abe84077 with Priority: HIGHEST for action port [ 848.449744] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76312788-a044-46c4-912d-a43bc9c8e59f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.449744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.449744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.450218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.450218] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76312788-a044-46c4-912d-a43bc9c8e59f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.454919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-76312788-a044-46c4-912d-a43bc9c8e59f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.454919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.454919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.454919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.454919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.454919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.454919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.454919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.454919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.454919] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76312788-a044-46c4-912d-a43bc9c8e59f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.454919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-01223b61-c661-4233-929d-e668abe84077 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.454919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01223b61-c661-4233-929d-e668abe84077" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.455698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01223b61-c661-4233-929d-e668abe84077" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.455698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01223b61-c661-4233-929d-e668abe84077" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.455698] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01223b61-c661-4233-929d-e668abe84077',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.621280] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.621618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.621618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.621770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.621842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.622072] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.622175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.622241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.622388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.622466] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.622546] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 is going to be updated. [ 848.648017] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 424e0166-59a6-441d-abf8-1fa9f2584819 in Status: SUCCESS [ 848.648427] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.660780] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.660959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.661016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.661221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.661384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.672468] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 in Status: IN_PROGRESS for 2s [ 848.794018] env[65553]: INFO networking_nsxv3.common.synchronization [None req-93ff80be-e702-431d-b63a-e2c68d7af075 None None] Enqueued Resource ID: 0c0866cb-5f66-4867-be76-356108024cbc with Priority: HIGHEST for action port [ 848.794512] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c0866cb-5f66-4867-be76-356108024cbc with Priority: HIGHEST for action port [ 848.794936] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c0866cb-5f66-4867-be76-356108024cbc taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.795658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c0866cb-5f66-4867-be76-356108024cbc" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.795749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c0866cb-5f66-4867-be76-356108024cbc" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.796205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c0866cb-5f66-4867-be76-356108024cbc" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.796205] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c0866cb-5f66-4867-be76-356108024cbc',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.958266] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76312788-a044-46c4-912d-a43bc9c8e59f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.959874] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-76312788-a044-46c4-912d-a43bc9c8e59f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.960521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.961345] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01223b61-c661-4233-929d-e668abe84077 with status ACTIVE [ 848.962290] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.962429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.962677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.962830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.962972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.963269] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.963427] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.963507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.964185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.964185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.964185] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.964185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.964352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.964352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.964433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.965185] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01223b61-c661-4233-929d-e668abe84077 is going to be updated. [ 849.008255] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.008255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.008670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.009692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.009692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.009692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01223b61-c661-4233-929d-e668abe84077" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.016433] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: SUCCESS [ 849.016643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.016810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.017208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.017474] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.018029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.018119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.018325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.018505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.018567] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.020379] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 in Status: SUCCESS [ 849.020474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.020659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.020863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.021198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.021292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.021335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.025022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.025022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.025022] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65313ec8-b8c4-4906-8f60-f1a528eb15a0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.169731] env[65553]: INFO networking_nsxv3.common.synchronization [req-5a39c5f2-eb2e-41d2-aaea-c2002061fdf8 req-45e67a41-c79b-4553-a890-d467abfb0340 tempest-ServersV294TestFqdnHostnames-1467859160 tempest-ServersV294TestFqdnHostnames-1467859160-project-member] Enqueued Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_members [ 849.171082] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_members [ 849.171486] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-510c04b8-85b7-4488-b4cf-5880529fe0b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.172354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.172354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.172354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.173187] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.173380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.173527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.173697] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.173815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.174982] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.298948] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c0866cb-5f66-4867-be76-356108024cbc [ 849.300800] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.300800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.300800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.300800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.300800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.300800] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c0866cb-5f66-4867-be76-356108024cbc already deleted. [ 849.300800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c0866cb-5f66-4867-be76-356108024cbc" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.467988] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76312788-a044-46c4-912d-a43bc9c8e59f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.512486] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 849.512761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.512935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.513194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.513408] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.513767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.513767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.513767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.513995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.513995] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.527455] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.529630] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65313ec8-b8c4-4906-8f60-f1a528eb15a0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.677537] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.677841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.677974] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.678381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.678434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.678766] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.679761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.679761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.679761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.679761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.679761] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 already deleted. [ 849.679761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.687318] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.687580] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-831" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.687580] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-831" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.688702] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-831" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.688830] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.689015] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.689098] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.689343] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.689527] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.689733] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.689867] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.690331] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.690499] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.690632] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.690632] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.690751] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.719576] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.719661] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 849.719857] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.720111] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-831" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.720504] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-7be58fe7-de0b-4478-a7b7-ab74af9d0398 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.720746] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-7be58fe7-de0b-4478-a7b7-ab74af9d0398" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.720922] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-7be58fe7-de0b-4478-a7b7-ab74af9d0398" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.721338] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-7be58fe7-de0b-4478-a7b7-ab74af9d0398" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.721529] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7be58fe7-de0b-4478-a7b7-ab74af9d0398',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.972791] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.972791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.972791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.972791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.972791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.972791] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76312788-a044-46c4-912d-a43bc9c8e59f is going to be created. [ 849.996613] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.996813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.996813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.997029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.997201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.009112] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76312788-a044-46c4-912d-a43bc9c8e59f in Status: UNINITIALIZED for 2s [ 850.016398] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.031182] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.032474] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65313ec8-b8c4-4906-8f60-f1a528eb15a0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.223883] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.224244] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.224334] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.224592] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.224739] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.224891] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 7be58fe7-de0b-4478-a7b7-ab74af9d0398 not found, creating... [ 850.225175] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.225329] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.225444] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.225654] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.227016] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.227016] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.227016] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.227016] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.227016] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.227016] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.227016] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 7be58fe7-de0b-4478-a7b7-ab74af9d0398 is going to be created. [ 850.250913] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.251320] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.251558] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.251966] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.252417] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.252744] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-7be58fe7-de0b-4478-a7b7-ab74af9d0398" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.342047] env[65553]: INFO networking_nsxv3.common.synchronization [req-9fdd4166-4761-4dd5-ac2b-7e545605552b req-bb99185c-823e-419d-800e-8221ab957094 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_members [ 850.342047] env[65553]: INFO networking_nsxv3.common.synchronization [req-9fdd4166-4761-4dd5-ac2b-7e545605552b req-bb99185c-823e-419d-800e-8221ab957094 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 850.342186] env[65553]: INFO networking_nsxv3.common.synchronization [req-9fdd4166-4761-4dd5-ac2b-7e545605552b req-bb99185c-823e-419d-800e-8221ab957094 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 with Priority: HIGHEST for action security_group_members [ 850.342719] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 with Priority: HIGHEST for action security_group_members [ 850.342848] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 850.343101] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 with Priority: HIGHEST for action security_group_members [ 850.343411] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-354651da-2fa6-41a7-a3bb-8655872e6da5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.343550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.343798] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.343954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.344196] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-65313ec8-b8c4-4906-8f60-f1a528eb15a0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.344313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.518836] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.534198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.534410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.534461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.534750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.534789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.534886] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 is going to be updated. [ 850.536409] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.536541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.536614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.536816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.536926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.537092] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 is going to be updated. [ 850.575537] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.575690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.575758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.576057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.576236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.578019] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.578153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.578221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.578394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.578516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.592315] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: IN_PROGRESS for 2s [ 850.592315] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 in Status: IN_PROGRESS for 2s [ 850.684839] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 in Status: SUCCESS [ 850.684839] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 deletion is rescheduled due to dependency. [ 850.684966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.969108] env[65553]: INFO networking_nsxv3.common.synchronization [req-5a39c5f2-eb2e-41d2-aaea-c2002061fdf8 req-11496071-0f1b-471c-90f9-cac7362235cc service nova] Enqueued Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_rules [ 850.969236] env[65553]: INFO networking_nsxv3.common.synchronization [req-5a39c5f2-eb2e-41d2-aaea-c2002061fdf8 req-11496071-0f1b-471c-90f9-cac7362235cc service nova] Enqueued Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_members [ 850.969975] env[65553]: INFO networking_nsxv3.common.synchronization [req-5a39c5f2-eb2e-41d2-aaea-c2002061fdf8 req-11496071-0f1b-471c-90f9-cac7362235cc service nova] Enqueued Resource ID: 7be58fe7-de0b-4478-a7b7-ab74af9d0398 with Priority: HIGHEST for action port [ 850.970156] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_rules [ 850.970290] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_members [ 850.970413] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7be58fe7-de0b-4478-a7b7-ab74af9d0398 with Priority: HIGHEST for action port [ 850.970759] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-510c04b8-85b7-4488-b4cf-5880529fe0b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.973474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.973474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.973474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.973474] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.973474] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-510c04b8-85b7-4488-b4cf-5880529fe0b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.973474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.973474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.973474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.973474] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.973474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.973474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.973474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.973474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.973474] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.974568] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-7be58fe7-de0b-4478-a7b7-ab74af9d0398 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.974680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7be58fe7-de0b-4478-a7b7-ab74af9d0398" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.974750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7be58fe7-de0b-4478-a7b7-ab74af9d0398" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.974905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7be58fe7-de0b-4478-a7b7-ab74af9d0398" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.974981] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7be58fe7-de0b-4478-a7b7-ab74af9d0398',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.024448] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.024604] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.024680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.024964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.025082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.025217] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 851.061233] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.061395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.061439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.061643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.061787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.075753] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 851.477161] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.479960] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-510c04b8-85b7-4488-b4cf-5880529fe0b5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.479960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.479960] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7be58fe7-de0b-4478-a7b7-ab74af9d0398 with status ACTIVE [ 851.481288] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.481288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.481288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.481288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.481288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.481288] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.481659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.481802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.482063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.482818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.482818] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.482818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.482818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.482818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.485018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.485018] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7be58fe7-de0b-4478-a7b7-ab74af9d0398 is going to be updated. [ 851.507180] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.507738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.507983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.508496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.508740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.509013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7be58fe7-de0b-4478-a7b7-ab74af9d0398" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.570199] env[65553]: INFO networking_nsxv3.common.synchronization [req-ba596b7e-c7e5-42a7-88b9-90de83b3775c req-db535a97-8624-4077-9ccb-49884dca6737 tempest-ImagesTestJSON-1118693169 tempest-ImagesTestJSON-1118693169-project-member] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 851.570640] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 851.571149] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.571526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.571750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.572216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.572539] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.572824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.573032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.573338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.573564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.573849] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.981293] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.025022] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76312788-a044-46c4-912d-a43bc9c8e59f in Status: SUCCESS [ 852.025022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.025022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.025022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.025022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.025022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.025022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.025022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.025022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.025022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.025022] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76312788-a044-46c4-912d-a43bc9c8e59f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.077933] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.487380] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.487380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.487380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.490481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.490481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.490481] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 is going to be created. [ 852.519802] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.519802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.519802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.520185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.520185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.528342] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76312788-a044-46c4-912d-a43bc9c8e59f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.533462] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 in Status: UNINITIALIZED for 2s [ 852.584229] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.624093] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: SUCCESS [ 852.624326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.625467] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 in Status: SUCCESS [ 852.625691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.625882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.626221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.626443] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.626573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.626639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.626815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.626888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.626982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.627465] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.628754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.628940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.629151] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.629279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.629347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.629575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.629664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.629862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.629937] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65313ec8-b8c4-4906-8f60-f1a528eb15a0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.631169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.631416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.631767] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.631901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.631967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.632136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.632217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.632314] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.633558] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.633742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.633923] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.634070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.634138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.634295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.634404] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.634486] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65313ec8-b8c4-4906-8f60-f1a528eb15a0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.033251] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76312788-a044-46c4-912d-a43bc9c8e59f: rpc.has_security_group_logging(os_id): False [ 853.057833] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.058094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.058094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.058451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.058597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.058880] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.059064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.059140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.059307] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.059403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.059468] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76312788-a044-46c4-912d-a43bc9c8e59f is going to be created. [ 853.085369] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.085369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.085752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.085752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.086077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.086077] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 853.087928] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 853.088234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.088317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.088556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.088735] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.088850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.088909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.089072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.089155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.089240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.089357] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.091511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.091511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.092261] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.092388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.092448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.092609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.092690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.093469] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.132626] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('354651da-2fa6-41a7-a3bb-8655872e6da5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.136223] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65313ec8-b8c4-4906-8f60-f1a528eb15a0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.137336] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.137454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.137521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.137726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.137813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.138282] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.138282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.138282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.138714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.138714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.138714] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 is going to be updated. [ 853.141739] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.142577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.142952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.142952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.143155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.144829] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.144829] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.144990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.145172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.145300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.145542] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.145692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.146078] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.146161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.146312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.146454] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 is going to be deleted. [ 853.181559] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 853.196363] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.196479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.196625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.196772] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.197240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.245282] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76312788-a044-46c4-912d-a43bc9c8e59f in Status: IN_PROGRESS for 2s [ 853.247811] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.248163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.248163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.248326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.248384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.248461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.254058] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.254279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.254399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.254739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.254952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.280809] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: IN_PROGRESS for 2s [ 853.594809] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.594809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.596290] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.634770] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 354651da-2fa6-41a7-a3bb-8655872e6da5: rpc.has_security_group_logging(os_id): False [ 853.645566] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65313ec8-b8c4-4906-8f60-f1a528eb15a0: rpc.has_security_group_logging(os_id): False [ 853.656611] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.656838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.656933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.657300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.657406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.657657] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.657771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.657835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.658045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.658259] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.658259] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 is going to be updated. [ 853.676415] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.676626] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.676626] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.678162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.678162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.678162] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.678162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.678162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.678162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.678162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.678162] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 is going to be created. [ 853.725050] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/65313ec8-b8c4-4906-8f60-f1a528eb15a0], does not exist path=[/infra/domains/default/groups/65313ec8-b8c4-4906-8f60-f1a528eb15a0]."\n}' [ 853.729021] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/65313ec8-b8c4-4906-8f60-f1a528eb15a0 [ 853.729021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 853.743271] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.743475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.743475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.743685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.743821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.762410] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: IN_PROGRESS for 2s [ 853.781622] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.781770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.781839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.782074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.783486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.783486] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.783486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.783751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.784932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.784932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.784932] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.784932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.784932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.784932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.784932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.784932] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65313ec8-b8c4-4906-8f60-f1a528eb15a0 is going to be created. [ 853.825874] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/65313ec8-b8c4-4906-8f60-f1a528eb15a0], does not exist path=[/infra/domains/default/groups/65313ec8-b8c4-4906-8f60-f1a528eb15a0]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/65313ec8-b8c4-4906-8f60-f1a528eb15a0 [ 853.826148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65313ec8-b8c4-4906-8f60-f1a528eb15a0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.826695] env[65553]: Traceback (most recent call last): [ 853.826695] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 853.826695] env[65553]: return func(*args, **kwargs) [ 853.826852] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 853.826852] env[65553]: res.raise_for_status() [ 853.826852] env[65553]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 853.826852] env[65553]: raise HTTPError(http_error_msg, response=self) [ 853.826852] env[65553]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/65313ec8-b8c4-4906-8f60-f1a528eb15a0 [ 853.826852] env[65553]: During handling of the above exception, another exception occurred: [ 853.826852] env[65553]: Traceback (most recent call last): [ 853.826852] env[65553]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 853.826852] env[65553]: listener.cb(fileno) [ 853.826852] env[65553]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 853.826852] env[65553]: result = function(*args, **kwargs) [ 853.826852] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 853.826852] env[65553]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 853.826852] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 853.826852] env[65553]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 853.826852] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 853.826852] env[65553]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 853.826852] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 853.826852] env[65553]: res.raise_for_status() [ 853.826852] env[65553]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 853.826852] env[65553]: raise HTTPError(http_error_msg, response=self) [ 853.826852] env[65553]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/65313ec8-b8c4-4906-8f60-f1a528eb15a0 [ 853.826852] env[65553]: Removing descriptor: 65 [ 854.099961] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.384926] env[65553]: INFO networking_nsxv3.common.synchronization [req-1865858f-f16d-4c0a-b353-abf00cb1c63a req-bcaf5aae-85bd-4675-810a-d942118be83a tempest-ListImageFiltersTestJSON-1822898395 tempest-ListImageFiltersTestJSON-1822898395-project-member] Enqueued Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 854.384926] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 854.385495] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.385620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.385687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.385891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.386110] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.386207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.386274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.386697] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.386832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.387099] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.551091] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 in Status: SUCCESS [ 854.551339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.551518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.551769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.551985] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.552151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.552151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.552326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.552409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.552584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.552584] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.601755] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.602191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.602191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.602337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.602337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.602457] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 854.658548] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.658710] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.658784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.659122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.659204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.671382] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 854.673649] env[65553]: INFO networking_nsxv3.common.synchronization [req-96747223-751c-4b56-aeb8-7d45ecf0e599 req-b9391986-209c-467c-aee9-f5011dcc47ce tempest-ServerMetadataTestJSON-1818714194 tempest-ServerMetadataTestJSON-1818714194-project-member] Enqueued Resource ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 with Priority: HIGHEST for action security_group_members [ 854.674452] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 with Priority: HIGHEST for action security_group_members [ 854.674806] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f80555d1-ee88-4624-af40-5a9e62b1a6a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.674976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.675104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.675373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.675704] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.675704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.675966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.676192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.676293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.676377] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f80555d1-ee88-4624-af40-5a9e62b1a6a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.894020] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.055189] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.179366] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.179545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.179632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.179916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.193426] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 855.193744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.203232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.203232] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.203232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.203232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.203232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.203232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.203232] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 is going to be updated. [ 855.233324] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.233492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.233556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.233739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.233900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.246793] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 in Status: IN_PROGRESS for 2s [ 855.264042] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76312788-a044-46c4-912d-a43bc9c8e59f in Status: SUCCESS [ 855.264301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.309934] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: SUCCESS [ 855.309934] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 deletion is rescheduled due to dependency. [ 855.309934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.395448] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.557850] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 510c04b8-85b7-4488-b4cf-5880529fe0b5: rpc.has_security_group_logging(os_id): False [ 855.580757] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.580928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.581032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.581672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.581672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.581926] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.582436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.582436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.582436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.582436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.582605] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 is going to be created. [ 855.650047] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.650418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.650418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.650676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.650676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.668777] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 in Status: IN_PROGRESS for 2s [ 855.806756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 354651da-2fa6-41a7-a3bb-8655872e6da5 in Status: SUCCESS [ 855.806756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-354651da-2fa6-41a7-a3bb-8655872e6da5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.897827] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.897995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.898318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.898406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.898564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.898775] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 is going to be updated. [ 855.954935] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.955191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.955307] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.955614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.955878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.974820] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: IN_PROGRESS for 2s [ 856.683883] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 856.683883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.684325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.684325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.684493] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.684493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.684602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.684779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.684779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.684964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.685475] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.685475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.685475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.685702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.685702] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.685806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.685859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.685997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.686086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.686146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.686238] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.163501] env[65553]: INFO networking_nsxv3.common.synchronization [None req-a2e83261-0b52-41bf-b827-6785d55baebe tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_rules [ 857.164054] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_rules [ 857.164375] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.164495] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.164561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.164863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.164904] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.190338] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a86c04db-ddf8-419d-8a90-125d10e637f6: rpc.has_security_group_logging(os_id): False [ 857.211210] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.211210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.211210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.211210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.235932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.236335] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.236518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.236518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.237076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.237076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.237076] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.237285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.237285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.237384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.237435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.237600] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.237702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.237765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.237905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.238061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.238145] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 857.262748] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 in Status: SUCCESS [ 857.262991] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 deletion is rescheduled due to dependency. [ 857.263125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.320821] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.320968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.321049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.321273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.321419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.342361] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 857.387945] env[65553]: INFO networking_nsxv3.common.synchronization [None req-82dab776-cd03-4608-b069-4eca31a45d78 tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_rules [ 857.388038] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_rules [ 857.388427] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.388572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.682062] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 in Status: SUCCESS [ 857.682178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.686911] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.687473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.687473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.687684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.687775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.687873] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d already deleted. [ 857.687958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.688130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.688311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.688406] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.985246] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: SUCCESS [ 857.985469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.211931] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.211931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.211931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.211931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.211931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.211931] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d already deleted. [ 858.211931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.362189] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 859.362575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.462339] env[65553]: INFO networking_nsxv3.common.synchronization [None req-26d60139-01f2-47b0-8a9b-7d0b52ca24f6 None None] Enqueued Resource ID: 40e54b62-3206-42d9-bd39-05f46703e0d9 with Priority: HIGHEST for action port [ 859.462339] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40e54b62-3206-42d9-bd39-05f46703e0d9 with Priority: HIGHEST for action port [ 859.462339] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-40e54b62-3206-42d9-bd39-05f46703e0d9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.462339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40e54b62-3206-42d9-bd39-05f46703e0d9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.462655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40e54b62-3206-42d9-bd39-05f46703e0d9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.462655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40e54b62-3206-42d9-bd39-05f46703e0d9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.462742] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40e54b62-3206-42d9-bd39-05f46703e0d9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.966942] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40e54b62-3206-42d9-bd39-05f46703e0d9 [ 859.967239] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.967713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.967855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.968047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.968146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.968244] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40e54b62-3206-42d9-bd39-05f46703e0d9 already deleted. [ 859.968347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40e54b62-3206-42d9-bd39-05f46703e0d9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.317032] env[65553]: INFO networking_nsxv3.common.synchronization [None req-53a19ecc-8472-4991-9cda-16b75d9a5894 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_rules [ 860.317161] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_rules [ 860.317468] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d71eb658-afb5-408d-a69d-dac4485c2f2e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.317588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.317654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.317949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.318188] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.463476] env[65553]: INFO networking_nsxv3.common.synchronization [None req-9e2b0e63-73d5-4a72-b6ca-5f33d9ccc6fa tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_rules [ 860.464264] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_rules [ 860.464264] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d71eb658-afb5-408d-a69d-dac4485c2f2e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.464264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.843841] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.844068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.844155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.844399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.844516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.844675] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d71eb658-afb5-408d-a69d-dac4485c2f2e already deleted. [ 860.844738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.844912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.845101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.845188] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.368540] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.368773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.368773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.368973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.369280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.369377] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d71eb658-afb5-408d-a69d-dac4485c2f2e already deleted. [ 861.369427] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.947393] env[65553]: INFO networking_nsxv3.common.synchronization [req-8e157b39-1d17-4be9-8138-99364e4882f9 req-3fa42728-1f9b-4125-ae3b-cdd46dfc4f67 tempest-ServerActionsTestOtherB-2131075409 tempest-ServerActionsTestOtherB-2131075409-project-member] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 861.948454] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 861.948454] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.948454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.948625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.974247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.974382] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.974505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.974572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.974762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.974851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.974951] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.160546] env[65553]: INFO networking_nsxv3.common.synchronization [None req-e505e12c-e3f1-4926-bfc3-983435dec1e4 tempest-AttachVolumeShelveTestJSON-653256025 tempest-AttachVolumeShelveTestJSON-653256025-project-member] Enqueued Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_rules [ 862.160546] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_rules [ 862.160546] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2ef9829-ef49-436a-a11a-bae751628c4a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.162986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.162986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.162986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.162986] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.334318] env[65553]: INFO networking_nsxv3.common.synchronization [None req-3fd37087-deb5-4d1f-919f-956fff95e818 tempest-AttachVolumeShelveTestJSON-653256025 tempest-AttachVolumeShelveTestJSON-653256025-project-member] Enqueued Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_rules [ 862.334318] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_rules [ 862.334804] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2ef9829-ef49-436a-a11a-bae751628c4a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.334804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.483624] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.483624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.483624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.483624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.483624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.483624] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.483624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.483624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.483624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.483624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.483624] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a already deleted. [ 862.483624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.701985] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.701985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.701985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.701985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.701985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.701985] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2ef9829-ef49-436a-a11a-bae751628c4a already deleted. [ 862.701985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.701985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.701985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.701985] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.718878] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f820cb79-3d47-468a-81d4-bd3f4c61166f None None] Enqueued Resource ID: 1e70ece5-0e5c-4226-a3d5-b17b6f3cdd8c with Priority: HIGHEST for action port [ 862.718878] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e70ece5-0e5c-4226-a3d5-b17b6f3cdd8c with Priority: HIGHEST for action port [ 862.718878] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e70ece5-0e5c-4226-a3d5-b17b6f3cdd8c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.718878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e70ece5-0e5c-4226-a3d5-b17b6f3cdd8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.718878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e70ece5-0e5c-4226-a3d5-b17b6f3cdd8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.718878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e70ece5-0e5c-4226-a3d5-b17b6f3cdd8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.718878] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e70ece5-0e5c-4226-a3d5-b17b6f3cdd8c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.917457] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.917641] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.917764] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.918119] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.918405] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.918629] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.918759] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.918986] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.919248] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.919547] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.919662] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.919771] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.919877] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.919994] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.920099] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.920228] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.942924] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.943116] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 862.943420] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.943663] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.944154] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-fa22843e-9b79-4a6b-bd59-e6990d2380fb taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.944531] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-fa22843e-9b79-4a6b-bd59-e6990d2380fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.944784] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-fa22843e-9b79-4a6b-bd59-e6990d2380fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.945268] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-fa22843e-9b79-4a6b-bd59-e6990d2380fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.945419] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa22843e-9b79-4a6b-bd59-e6990d2380fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.212883] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.213153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.213153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.213311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.213400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.213480] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2ef9829-ef49-436a-a11a-bae751628c4a already deleted. [ 863.213565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.221109] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e70ece5-0e5c-4226-a3d5-b17b6f3cdd8c [ 863.221291] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.221374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.221422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.221620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.221704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.221797] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e70ece5-0e5c-4226-a3d5-b17b6f3cdd8c already deleted. [ 863.221873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e70ece5-0e5c-4226-a3d5-b17b6f3cdd8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.448507] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.449174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.449174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.449339] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.449339] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.449520] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port fa22843e-9b79-4a6b-bd59-e6990d2380fb not found, creating... [ 863.449933] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.450059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.450093] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.450389] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.450492] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.450811] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.450968] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.451089] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.451310] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.451451] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.451588] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: fa22843e-9b79-4a6b-bd59-e6990d2380fb is going to be created. [ 863.475957] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.476323] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.476505] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.476772] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.477065] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.477336] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-fa22843e-9b79-4a6b-bd59-e6990d2380fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.228314] env[65553]: INFO networking_nsxv3.common.synchronization [req-8e157b39-1d17-4be9-8138-99364e4882f9 req-df5147f5-d5c5-4958-92b9-690b802b4852 service nova] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 864.228518] env[65553]: INFO networking_nsxv3.common.synchronization [req-8e157b39-1d17-4be9-8138-99364e4882f9 req-df5147f5-d5c5-4958-92b9-690b802b4852 service nova] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 864.228594] env[65553]: INFO networking_nsxv3.common.synchronization [req-8e157b39-1d17-4be9-8138-99364e4882f9 req-df5147f5-d5c5-4958-92b9-690b802b4852 service nova] Enqueued Resource ID: fa22843e-9b79-4a6b-bd59-e6990d2380fb with Priority: HIGHEST for action port [ 864.228830] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 864.228958] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 864.229067] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa22843e-9b79-4a6b-bd59-e6990d2380fb with Priority: HIGHEST for action port [ 864.230219] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.230388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.230418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.230615] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.230698] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.232437] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.232437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.232437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.232437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.232437] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.232437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.232437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.232949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.233020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.233114] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.235421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa22843e-9b79-4a6b-bd59-e6990d2380fb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.235421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa22843e-9b79-4a6b-bd59-e6990d2380fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.235421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa22843e-9b79-4a6b-bd59-e6990d2380fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.235421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa22843e-9b79-4a6b-bd59-e6990d2380fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.235421] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa22843e-9b79-4a6b-bd59-e6990d2380fb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.371616] env[65553]: INFO networking_nsxv3.common.synchronization [req-fc2e475d-8595-4b40-ab05-1989f912df1d req-ec245f87-32cb-4dbd-8fa9-11cd833fe74b tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 864.372143] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 864.372440] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.372918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.375080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.375080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.375080] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.375080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.375080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.375080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.375080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.375080] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.736292] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.740109] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa22843e-9b79-4a6b-bd59-e6990d2380fb with status ACTIVE [ 864.740109] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.740109] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.740109] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.740109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.740109] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa22843e-9b79-4a6b-bd59-e6990d2380fb is going to be updated. [ 864.742238] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.742538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.767601] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.769096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.769096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.769096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.769096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.769096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa22843e-9b79-4a6b-bd59-e6990d2380fb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.804018] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.804018] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.804018] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.804018] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.804018] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.804018] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.804018] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.804403] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.804638] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.804996] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.805224] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.805407] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.805586] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.806252] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.806466] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.806707] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.843019] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.843019] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 864.843019] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.843019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.843019] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-8a172922-4042-4784-a6bd-596be931ca32 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.843019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-8a172922-4042-4784-a6bd-596be931ca32" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.843019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-8a172922-4042-4784-a6bd-596be931ca32" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.843019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-8a172922-4042-4784-a6bd-596be931ca32" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.843019] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a172922-4042-4784-a6bd-596be931ca32',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.878177] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.878177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.878177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.878177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.878177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.878177] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.878177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.878177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.878177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.878177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.878177] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 already deleted. [ 864.878177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.238046] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.345409] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.346708] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.346708] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.346907] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.348620] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.348620] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 8a172922-4042-4784-a6bd-596be931ca32 not found, creating... [ 865.348620] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.348620] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.348620] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.348620] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.348620] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.349296] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.349583] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.349868] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.350661] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.350984] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.351299] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 8a172922-4042-4784-a6bd-596be931ca32 is going to be created. [ 865.375555] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.375829] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.376020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.376385] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.376643] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.376948] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-8a172922-4042-4784-a6bd-596be931ca32" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.742574] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.742740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.742812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.743057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.743151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.743246] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be created. [ 865.770125] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.770355] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.770355] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.770549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.770702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.781506] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: UNINITIALIZED for 2s [ 866.086958] env[65553]: INFO networking_nsxv3.common.synchronization [req-fc2e475d-8595-4b40-ab05-1989f912df1d req-e8e94770-8c31-47e5-90fc-faf81f7e2da6 service nova] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_rules [ 866.087055] env[65553]: INFO networking_nsxv3.common.synchronization [req-fc2e475d-8595-4b40-ab05-1989f912df1d req-e8e94770-8c31-47e5-90fc-faf81f7e2da6 service nova] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 866.087334] env[65553]: INFO networking_nsxv3.common.synchronization [req-fc2e475d-8595-4b40-ab05-1989f912df1d req-e8e94770-8c31-47e5-90fc-faf81f7e2da6 service nova] Enqueued Resource ID: 8a172922-4042-4784-a6bd-596be931ca32 with Priority: HIGHEST for action port [ 866.087762] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_rules [ 866.087944] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 866.090042] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a172922-4042-4784-a6bd-596be931ca32 with Priority: HIGHEST for action port [ 866.090042] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.090042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.090042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.090042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.090042] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.090518] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.090639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.090708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.091029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.091169] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.091273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.091330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.091577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.091577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.091665] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.093467] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a172922-4042-4784-a6bd-596be931ca32 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.093467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a172922-4042-4784-a6bd-596be931ca32" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.093628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a172922-4042-4784-a6bd-596be931ca32" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.093804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a172922-4042-4784-a6bd-596be931ca32" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.093887] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a172922-4042-4784-a6bd-596be931ca32',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.594486] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.597088] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a172922-4042-4784-a6bd-596be931ca32 with status ACTIVE [ 866.597088] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.597088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.597088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.597088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.597088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.597088] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.597088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.597088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.597583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.597583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.598477] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.598477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.598477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.598477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.598477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.598477] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a172922-4042-4784-a6bd-596be931ca32 is going to be updated. [ 866.599602] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.599704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.623474] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.623642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.623682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.623890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.624040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.624204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a172922-4042-4784-a6bd-596be931ca32" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.100894] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.604503] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.605308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.605308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.605308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.605308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.605308] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be created. [ 867.635476] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.635643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.635677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.635883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.636123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.651167] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: UNINITIALIZED for 2s [ 867.794166] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 867.794499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.794712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.794950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.795197] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.795366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.795505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.795716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.796079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.796214] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.796339] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.300659] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.802501] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 015f5088-3b94-432c-9304-6fd98b4fe26a: rpc.has_security_group_logging(os_id): False [ 868.825613] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.825816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.825816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.825995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.826067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.826341] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.826452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.826508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.826668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.826856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.826856] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be created. [ 868.904635] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.904817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.904880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.905088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.905364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.918054] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 869.222026] env[65553]: INFO networking_nsxv3.common.synchronization [req-4aec50f3-0ae9-41b8-b762-25437ca324ac req-4c1e4a5d-ea56-4f20-9d8a-502c9c5b9a9f tempest-ImagesOneServerNegativeTestJSON-967710394 tempest-ImagesOneServerNegativeTestJSON-967710394-project-member] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 869.222618] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 869.222936] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.223161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.225994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.225994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.225994] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.225994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.225994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.225994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.225994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.225994] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.613894] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-236 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.613894] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.613894] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.615039] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.615644] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.621683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.621683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.621683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.621683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.621683] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.621683] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.621683] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.621683] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.621683] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.621683] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.621683] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.655679] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.655889] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.656160] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.656413] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.656809] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-f58361b9-cc2f-4ae3-ae9e-0382f2696059 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.656988] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-f58361b9-cc2f-4ae3-ae9e-0382f2696059" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.657176] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-f58361b9-cc2f-4ae3-ae9e-0382f2696059" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.658641] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-f58361b9-cc2f-4ae3-ae9e-0382f2696059" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.658805] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f58361b9-cc2f-4ae3-ae9e-0382f2696059',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.664536] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 869.664834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.665075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.665408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.665660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.665845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.665923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.666188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.666299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.666527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.666678] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.728144] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.728318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.728455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.728698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.728790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.729027] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.729141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.729313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.729538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.729650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.729748] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be deleted. [ 869.776964] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.777195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.777275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.777595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.777729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.777797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.161542] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.161844] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.161844] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.162107] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.162268] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.162437] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port f58361b9-cc2f-4ae3-ae9e-0382f2696059 not found, creating... [ 870.162718] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.162838] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.162955] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.163217] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.163379] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.163685] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.163843] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.163966] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.164258] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.164410] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.164547] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: f58361b9-cc2f-4ae3-ae9e-0382f2696059 is going to be created. [ 870.169539] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.169692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.169730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.169932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.170103] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.170201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.170265] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.170405] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.170483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.170580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.170724] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.170811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.170869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.171032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.171173] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.171253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.171316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.171446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.171518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.171597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.171682] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.188687] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.188899] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.189027] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.189311] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.189530] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.189776] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-f58361b9-cc2f-4ae3-ae9e-0382f2696059" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.674518] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60f68fd-25de-4d38-bc93-3e4066ff8aa6: rpc.has_security_group_logging(os_id): False [ 870.698027] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.698027] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.698027] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.698027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.698824] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.699098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.699275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.699560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.699754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.701694] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be created. [ 870.762384] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.762551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.762588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.763128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.763128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.832812] env[65553]: INFO networking_nsxv3.common.synchronization [req-ff8ba8fb-52e9-422b-b0b5-0d66c6f85787 req-bd912924-21f6-4664-be07-f6bb66a6cdc3 tempest-ServersWithSpecificFlavorTestJSON-819002853 tempest-ServersWithSpecificFlavorTestJSON-819002853-project-member] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 870.833389] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGHEST for action security_group_members [ 870.833700] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.833813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.833880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.834288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.834458] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.834572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.835322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.835673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.835786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.835836] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.883282] env[65553]: INFO networking_nsxv3.common.synchronization [req-4aec50f3-0ae9-41b8-b762-25437ca324ac req-c5df09cb-4434-4206-b480-ffbd338919c7 service nova] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_rules [ 870.883591] env[65553]: INFO networking_nsxv3.common.synchronization [req-4aec50f3-0ae9-41b8-b762-25437ca324ac req-c5df09cb-4434-4206-b480-ffbd338919c7 service nova] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 870.883591] env[65553]: INFO networking_nsxv3.common.synchronization [req-4aec50f3-0ae9-41b8-b762-25437ca324ac req-c5df09cb-4434-4206-b480-ffbd338919c7 service nova] Enqueued Resource ID: f58361b9-cc2f-4ae3-ae9e-0382f2696059 with Priority: HIGHEST for action port [ 870.885096] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_rules [ 870.885096] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 870.885096] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58361b9-cc2f-4ae3-ae9e-0382f2696059 with Priority: HIGHEST for action port [ 870.885096] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.885096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.885096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.885549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.885586] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.887158] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.888176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.888254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.888880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.889057] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.889157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.889213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.889561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.889665] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.889774] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.890790] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-f58361b9-cc2f-4ae3-ae9e-0382f2696059 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.890905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f58361b9-cc2f-4ae3-ae9e-0382f2696059" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.890963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f58361b9-cc2f-4ae3-ae9e-0382f2696059" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.891118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f58361b9-cc2f-4ae3-ae9e-0382f2696059" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.891182] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f58361b9-cc2f-4ae3-ae9e-0382f2696059',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.900059] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 870.969981] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 870.969981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.339235] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.339576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.339576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.339695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.362234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.362523] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.362642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.362698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.362907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.362990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.363094] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a is going to be updated. [ 871.392277] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.392443] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.392488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.392726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.392873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.394034] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.394996] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.395117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.395303] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f58361b9-cc2f-4ae3-ae9e-0382f2696059 with status ACTIVE [ 871.395460] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.395563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.395630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.395864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.395956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.396299] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.396516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.396650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.396848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.396936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.397185] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.397286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.397396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.397572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.397654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.397743] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f58361b9-cc2f-4ae3-ae9e-0382f2696059 is going to be updated. [ 871.412333] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: IN_PROGRESS for 2s [ 871.426434] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.426587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.426663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.426860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.426996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.427194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f58361b9-cc2f-4ae3-ae9e-0382f2696059" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.899281] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.022434] env[65553]: INFO networking_nsxv3.common.synchronization [req-18032c86-d60d-426e-b700-dde6ed0aef71 req-d7a949aa-d52a-4955-bb9f-f4e990ba0be1 tempest-ServerActionsV293TestJSON-138104853 tempest-ServerActionsV293TestJSON-138104853-project-member] Enqueued Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_members [ 872.022992] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_members [ 872.023707] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d4374-c484-417a-aad8-0a36a186516f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.023833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.023900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.026543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.026543] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.026543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.026543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.026543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.026543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.026543] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d4374-c484-417a-aad8-0a36a186516f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.378519] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-677 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.378519] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-677" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.378519] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-677" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.378519] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-677" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.378519] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.379180] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.379359] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.379586] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.379728] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.379927] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.381432] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.381432] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.381432] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.381432] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.381432] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.381432] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.402162] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.402345] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 872.402481] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.402659] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-677" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.402982] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-4080e807-4931-47b2-80ee-11ed58b92224 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.403167] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-4080e807-4931-47b2-80ee-11ed58b92224" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.403285] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-4080e807-4931-47b2-80ee-11ed58b92224" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.403629] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-4080e807-4931-47b2-80ee-11ed58b92224" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.403769] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4080e807-4931-47b2-80ee-11ed58b92224',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.408749] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.408873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.408948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.409155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.409241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.409332] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be created. [ 872.441132] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.441283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.441343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.441561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.441850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.459431] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: UNINITIALIZED for 2s [ 872.530116] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.530116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.530116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.530116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.530116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.530116] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.530116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.530116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.530116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.530116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.530116] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d4374-c484-417a-aad8-0a36a186516f already deleted. [ 872.530116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.911929] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.912251] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.912384] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.912661] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.912809] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.912959] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 4080e807-4931-47b2-80ee-11ed58b92224 not found, creating... [ 872.913239] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.913392] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.913544] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.913769] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.913902] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.914208] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.914356] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.914468] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.914668] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.914797] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.914951] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 4080e807-4931-47b2-80ee-11ed58b92224 is going to be created. [ 872.916713] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 872.916898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.939846] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.940086] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.940215] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.940536] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.940719] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.940975] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-4080e807-4931-47b2-80ee-11ed58b92224" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.424231] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ed73c0e-357c-432a-a683-eda251f6d85a in Status: SUCCESS [ 873.424505] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a deletion is rescheduled due to dependency. [ 873.424553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.730632] env[65553]: INFO networking_nsxv3.common.synchronization [req-18032c86-d60d-426e-b700-dde6ed0aef71 req-8c6607e6-1af1-4911-aedc-e43a1361d0f1 service nova] Enqueued Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_rules [ 873.731305] env[65553]: INFO networking_nsxv3.common.synchronization [req-18032c86-d60d-426e-b700-dde6ed0aef71 req-8c6607e6-1af1-4911-aedc-e43a1361d0f1 service nova] Enqueued Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_members [ 873.731305] env[65553]: INFO networking_nsxv3.common.synchronization [req-18032c86-d60d-426e-b700-dde6ed0aef71 req-8c6607e6-1af1-4911-aedc-e43a1361d0f1 service nova] Enqueued Resource ID: 4080e807-4931-47b2-80ee-11ed58b92224 with Priority: HIGHEST for action port [ 873.731468] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_rules [ 873.731633] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_members [ 873.731687] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4080e807-4931-47b2-80ee-11ed58b92224 with Priority: HIGHEST for action port [ 873.732090] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-762d4374-c484-417a-aad8-0a36a186516f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.733016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.733016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.733016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.733016] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('762d4374-c484-417a-aad8-0a36a186516f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.733414] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d4374-c484-417a-aad8-0a36a186516f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.733520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.733581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.733738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.733877] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.733966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.734055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.734716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.734811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.734913] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d4374-c484-417a-aad8-0a36a186516f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.736192] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-4080e807-4931-47b2-80ee-11ed58b92224 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.736310] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4080e807-4931-47b2-80ee-11ed58b92224" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.736374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4080e807-4931-47b2-80ee-11ed58b92224" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.737058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4080e807-4931-47b2-80ee-11ed58b92224" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.737058] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4080e807-4931-47b2-80ee-11ed58b92224',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.239932] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d4374-c484-417a-aad8-0a36a186516f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.244671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.244671] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('762d4374-c484-417a-aad8-0a36a186516f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.246016] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4080e807-4931-47b2-80ee-11ed58b92224 with status ACTIVE [ 874.246274] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.246485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.246485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.246656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.246749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.246920] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.247076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.247076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.247278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.247354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.247518] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.247606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.247664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.247813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.247862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.247943] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4080e807-4931-47b2-80ee-11ed58b92224 is going to be updated. [ 874.273359] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.273585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.273695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.274026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.274242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.274464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4080e807-4931-47b2-80ee-11ed58b92224" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.472883] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: SUCCESS [ 874.473154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.473308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.473528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.473728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.473849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.473912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.474125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.474220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.474309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.474401] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.750832] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('762d4374-c484-417a-aad8-0a36a186516f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.983129] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.983129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.983129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.983129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.983129] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.983129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.983129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.983129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.983129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.983129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.983129] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.983129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.983129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.983621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.983621] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.983621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.983621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.983730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.983789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.983869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.983960] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.256545] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.256545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.256545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.256545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.256545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.256545] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d4374-c484-417a-aad8-0a36a186516f is going to be created. [ 875.286253] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.286253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.286253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.286253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.286253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.297207] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d4374-c484-417a-aad8-0a36a186516f in Status: UNINITIALIZED for 2s [ 875.489724] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d069dc70-d382-4790-b884-3c9bf5e88eb0: rpc.has_security_group_logging(os_id): False [ 875.519174] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.521035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.521035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.521035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.521035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.521497] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.521756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.521922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.522188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.522667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.522667] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.523098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.523295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.524082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.524082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.524082] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.524082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.524082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.524372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.524480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.528191] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be created. [ 875.597901] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.598247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.598247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.598545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.598621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.613571] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: IN_PROGRESS for 2s [ 877.307606] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d4374-c484-417a-aad8-0a36a186516f in Status: SUCCESS [ 877.307916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.309127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.309646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.309646] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.309646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.310111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.310111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.310111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.310111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.310550] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('762d4374-c484-417a-aad8-0a36a186516f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.312387] env[65553]: INFO networking_nsxv3.common.synchronization [req-ad9b7331-a066-4633-abf7-18b2af226a91 req-bde1c477-5058-4315-806c-e9f763404aba tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 877.314079] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 877.314079] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.314079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.314079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.314079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.314079] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.314079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.314588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.314588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.314588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.314588] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.635194] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: SUCCESS [ 877.635194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.748729] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.748729] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-484" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.748729] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-484" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.748729] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-484" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.748729] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.748964] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.750463] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.750794] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.751047] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.751323] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 877.751476] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.751733] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.751733] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.751859] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 877.751905] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.752111] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.795721] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.795927] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 877.796090] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.796335] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-484" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.796755] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-c5a57c5d-701e-43cc-b700-4eb759bf6b11 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.797905] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.797905] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.797905] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.797905] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a57c5d-701e-43cc-b700-4eb759bf6b11',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.813848] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('762d4374-c484-417a-aad8-0a36a186516f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.819049] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.819049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.819049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.819049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.819282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.819309] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.819408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.819468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.819642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.819718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.819798] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 already deleted. [ 877.819898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.168855] env[65553]: INFO networking_nsxv3.common.synchronization [None req-100a2ab6-db4d-4585-bb7e-9b36c65c7951 None None] Enqueued Resource ID: 52282146-eb24-47cf-a874-41e7283bed71 with Priority: HIGHEST for action port [ 878.169528] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52282146-eb24-47cf-a874-41e7283bed71 with Priority: HIGHEST for action port [ 878.169881] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-52282146-eb24-47cf-a874-41e7283bed71 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.170011] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52282146-eb24-47cf-a874-41e7283bed71" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.170496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52282146-eb24-47cf-a874-41e7283bed71" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.170616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52282146-eb24-47cf-a874-41e7283bed71" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.170700] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52282146-eb24-47cf-a874-41e7283bed71',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.300668] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.300903] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.301057] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.301429] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.301591] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.301748] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port c5a57c5d-701e-43cc-b700-4eb759bf6b11 not found, creating... [ 878.302025] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.302192] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.302308] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.302539] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.302678] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.302965] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.303132] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.303242] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.303460] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.303588] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.303741] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: c5a57c5d-701e-43cc-b700-4eb759bf6b11 is going to be created. [ 878.319409] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 762d4374-c484-417a-aad8-0a36a186516f: rpc.has_security_group_logging(os_id): False [ 878.331636] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.332213] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.332213] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.332360] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.332741] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.333095] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.339787] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.339984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.340038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.340531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.340531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.340723] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.340834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.340896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.341066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.341148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.341235] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 762d4374-c484-417a-aad8-0a36a186516f is going to be created. [ 878.413011] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.413332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.413430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.413711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.413909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.427885] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 762d4374-c484-417a-aad8-0a36a186516f in Status: IN_PROGRESS for 2s [ 878.672544] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52282146-eb24-47cf-a874-41e7283bed71 [ 878.672812] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.672956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.673053] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.675418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.675418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.675418] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52282146-eb24-47cf-a874-41e7283bed71 already deleted. [ 878.675418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52282146-eb24-47cf-a874-41e7283bed71" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.067735] env[65553]: INFO networking_nsxv3.common.synchronization [req-ad9b7331-a066-4633-abf7-18b2af226a91 req-aa30b0a1-52d4-430c-a1f9-73f65cb8b8f8 service nova] Enqueued Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_rules [ 879.067939] env[65553]: INFO networking_nsxv3.common.synchronization [req-ad9b7331-a066-4633-abf7-18b2af226a91 req-aa30b0a1-52d4-430c-a1f9-73f65cb8b8f8 service nova] Enqueued Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 879.068652] env[65553]: INFO networking_nsxv3.common.synchronization [req-ad9b7331-a066-4633-abf7-18b2af226a91 req-aa30b0a1-52d4-430c-a1f9-73f65cb8b8f8 service nova] Enqueued Resource ID: c5a57c5d-701e-43cc-b700-4eb759bf6b11 with Priority: HIGHEST for action port [ 879.070012] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_rules [ 879.070375] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 879.070624] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5a57c5d-701e-43cc-b700-4eb759bf6b11 with Priority: HIGHEST for action port [ 879.071753] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.072038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.072607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.072990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.073145] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.077187] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.077187] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.077187] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.077187] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.077187] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.077187] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.077187] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.077187] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.077187] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.077187] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.078526] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5a57c5d-701e-43cc-b700-4eb759bf6b11 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.078750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.078861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.079100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.079537] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a57c5d-701e-43cc-b700-4eb759bf6b11',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.589369] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.589369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.589369] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.594031] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5a57c5d-701e-43cc-b700-4eb759bf6b11 with status ACTIVE [ 879.594031] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.594031] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.594031] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.594031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.594031] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5a57c5d-701e-43cc-b700-4eb759bf6b11 is going to be updated. [ 879.631478] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.631666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.631705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.632437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.632611] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.634591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.078638] env[65553]: INFO networking_nsxv3.common.synchronization [req-2ceb9f8d-a6c7-4079-a150-fa65efc51324 req-4e6b36bb-1676-4811-afae-20bcb1b2a1a7 tempest-ImagesOneServerTestJSON-1339963175 tempest-ImagesOneServerTestJSON-1339963175-project-member] Enqueued Resource ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 with Priority: HIGHEST for action security_group_members [ 880.079189] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 with Priority: HIGHEST for action security_group_members [ 880.079505] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.079606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.079761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.079914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.080851] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.080977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.081056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.081232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.081319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.081514] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed7cc46a-1914-49e3-8b7d-d67e2682c5f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.090649] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.444903] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 762d4374-c484-417a-aad8-0a36a186516f in Status: SUCCESS [ 880.445174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.465200] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-575 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.465393] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-575" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.465516] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-575" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.465834] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-575" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.466470] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.466703] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.466776] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.467015] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.467162] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.467420] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.467530] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.467633] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.467735] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.467841] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.467942] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.468084] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.491463] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.491463] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 880.491463] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.491463] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-575" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.491463] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-2fdfa9f0-60f9-479f-a01e-ec395d45d5da taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.491816] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-2fdfa9f0-60f9-479f-a01e-ec395d45d5da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.491816] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-2fdfa9f0-60f9-479f-a01e-ec395d45d5da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.492372] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-2fdfa9f0-60f9-479f-a01e-ec395d45d5da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.496021] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fdfa9f0-60f9-479f-a01e-ec395d45d5da',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.584827] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.585668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.585668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.585668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.585668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.585668] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.585924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.585924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.585990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.586041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.586226] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 already deleted. [ 880.586375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.593131] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.593480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.593480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.593551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.593625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.593722] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 is going to be created. [ 880.622566] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.622721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.622792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.623011] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.623175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.635176] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: UNINITIALIZED for 2s [ 880.876868] env[65553]: INFO networking_nsxv3.common.synchronization [None req-533e961c-c92d-436b-9784-3cae1af4697f None None] Enqueued Resource ID: 9ce59b53-224b-4fe4-84c2-f166609c5b66 with Priority: HIGHEST for action port [ 880.877581] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce59b53-224b-4fe4-84c2-f166609c5b66 with Priority: HIGHEST for action port [ 880.878148] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ce59b53-224b-4fe4-84c2-f166609c5b66 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.878334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ce59b53-224b-4fe4-84c2-f166609c5b66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.878501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ce59b53-224b-4fe4-84c2-f166609c5b66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.878882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ce59b53-224b-4fe4-84c2-f166609c5b66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.879044] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ce59b53-224b-4fe4-84c2-f166609c5b66',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.996445] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.996704] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.996830] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.997152] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.997312] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.997464] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 2fdfa9f0-60f9-479f-a01e-ec395d45d5da not found, creating... [ 880.997744] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.997898] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.998028] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.998288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.998432] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.998752] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.998905] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.999030] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.999238] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.999371] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.999506] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 2fdfa9f0-60f9-479f-a01e-ec395d45d5da is going to be created. [ 881.023109] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.023332] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.023441] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.023739] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.023961] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.024223] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-2fdfa9f0-60f9-479f-a01e-ec395d45d5da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.381445] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ce59b53-224b-4fe4-84c2-f166609c5b66 [ 881.381711] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.381928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.382010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.382309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.382431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.382537] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ce59b53-224b-4fe4-84c2-f166609c5b66 already deleted. [ 881.382623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ce59b53-224b-4fe4-84c2-f166609c5b66" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.820694] env[65553]: INFO networking_nsxv3.common.synchronization [req-2ceb9f8d-a6c7-4079-a150-fa65efc51324 req-82c65d89-49f9-4723-ab2d-55a585393e7c service nova] Enqueued Resource ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 with Priority: HIGHEST for action security_group_rules [ 881.820958] env[65553]: INFO networking_nsxv3.common.synchronization [req-2ceb9f8d-a6c7-4079-a150-fa65efc51324 req-82c65d89-49f9-4723-ab2d-55a585393e7c service nova] Enqueued Resource ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 with Priority: HIGHEST for action security_group_members [ 881.821011] env[65553]: INFO networking_nsxv3.common.synchronization [req-2ceb9f8d-a6c7-4079-a150-fa65efc51324 req-82c65d89-49f9-4723-ab2d-55a585393e7c service nova] Enqueued Resource ID: 2fdfa9f0-60f9-479f-a01e-ec395d45d5da with Priority: HIGHEST for action port [ 881.821240] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 with Priority: HIGHEST for action security_group_rules [ 881.821377] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 with Priority: HIGHEST for action security_group_members [ 881.821474] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdfa9f0-60f9-479f-a01e-ec395d45d5da with Priority: HIGHEST for action port [ 881.821998] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.822163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.822199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.822436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.822519] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed7cc46a-1914-49e3-8b7d-d67e2682c5f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.823357] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.824286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.824286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.824286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.824286] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.824286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.824286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.824286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.824621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.824621] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed7cc46a-1914-49e3-8b7d-d67e2682c5f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.825125] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fdfa9f0-60f9-479f-a01e-ec395d45d5da taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.825250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fdfa9f0-60f9-479f-a01e-ec395d45d5da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.825286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fdfa9f0-60f9-479f-a01e-ec395d45d5da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.825899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fdfa9f0-60f9-479f-a01e-ec395d45d5da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.825899] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fdfa9f0-60f9-479f-a01e-ec395d45d5da',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.328366] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.329178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.329178] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed7cc46a-1914-49e3-8b7d-d67e2682c5f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.330929] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fdfa9f0-60f9-479f-a01e-ec395d45d5da with status ACTIVE [ 882.330929] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.330929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.330929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.330929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.330929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.330929] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.330929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.330929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.331289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.331289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.331289] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.331405] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.331405] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.333027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.333027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.333027] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fdfa9f0-60f9-479f-a01e-ec395d45d5da is going to be updated. [ 882.354030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.354030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.354030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.354247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.354309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.354480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fdfa9f0-60f9-479f-a01e-ec395d45d5da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.651366] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: SUCCESS [ 882.653982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.653982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.653982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.653982] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.653982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.653982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.653982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.653982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.655134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.655134] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.826057] env[65553]: INFO networking_nsxv3.common.synchronization [req-0e959319-f95e-48a3-9146-89ac40b5046a req-696d933f-a91b-48db-9f3f-677483817c30 tempest-ServersAdminTestJSON-844759989 tempest-ServersAdminTestJSON-844759989-project-member] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 882.826540] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 882.827540] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.827708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.827805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.828163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.828373] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.828513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.828605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.828823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.828957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.829096] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.833547] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed7cc46a-1914-49e3-8b7d-d67e2682c5f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.158019] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.158281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.158281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.158466] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.158698] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.158809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.158873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.159047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.159143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.159224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.160078] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.160223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.160285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.160560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.160714] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.160860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.160934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.161103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.161188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.161345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.161398] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.230074] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.230625] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.230801] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.231120] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.231425] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.231593] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.231719] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.231938] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.232134] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.232345] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.232453] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.233262] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.233393] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.233511] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.233623] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.233758] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.261048] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.261048] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.261048] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.261048] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-396" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.261048] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-961fddb2-a7cf-4208-91ee-d22a91eaf355 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.261500] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-961fddb2-a7cf-4208-91ee-d22a91eaf355" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.261500] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-961fddb2-a7cf-4208-91ee-d22a91eaf355" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.261868] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-961fddb2-a7cf-4208-91ee-d22a91eaf355" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.262081] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961fddb2-a7cf-4208-91ee-d22a91eaf355',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.331921] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.337777] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.337879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.337920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.338139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.338225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.338329] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 is going to be created. [ 883.364109] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.364262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.364327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.364552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.364716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.380246] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 in Status: UNINITIALIZED for 2s [ 883.666105] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac09d86f-1825-444d-b8fe-6cf1e194fce1: rpc.has_security_group_logging(os_id): False [ 883.686542] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.686826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.686826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.686952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.687049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.687289] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.687399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.687463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.687618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.687697] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.687958] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.688074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.688137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.688280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.688360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.688537] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.688629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.688690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.688826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.688900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.688984] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 is going to be created. [ 883.748720] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.748926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.748926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.749157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.749332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.765299] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: IN_PROGRESS for 2s [ 883.765299] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.765299] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.765299] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.765299] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.765299] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.765602] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 961fddb2-a7cf-4208-91ee-d22a91eaf355 not found, creating... [ 883.765704] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.765863] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.766777] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.766777] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.766777] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.766777] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.766968] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.766968] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.767266] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.767410] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.767543] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 961fddb2-a7cf-4208-91ee-d22a91eaf355 is going to be created. [ 883.790189] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.790388] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.790437] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.790699] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.790938] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.791174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-961fddb2-a7cf-4208-91ee-d22a91eaf355" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.835014] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.339375] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.339375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.339375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.339375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.339375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.339375] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 884.369819] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.369972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.370035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.370252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.370395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.381721] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 884.486945] env[65553]: INFO networking_nsxv3.common.synchronization [req-0e959319-f95e-48a3-9146-89ac40b5046a req-91dfbe3f-4c1b-4677-813f-b3c02f75e3d5 service nova] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_rules [ 884.487203] env[65553]: INFO networking_nsxv3.common.synchronization [req-0e959319-f95e-48a3-9146-89ac40b5046a req-91dfbe3f-4c1b-4677-813f-b3c02f75e3d5 service nova] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 884.487352] env[65553]: INFO networking_nsxv3.common.synchronization [req-0e959319-f95e-48a3-9146-89ac40b5046a req-91dfbe3f-4c1b-4677-813f-b3c02f75e3d5 service nova] Enqueued Resource ID: 961fddb2-a7cf-4208-91ee-d22a91eaf355 with Priority: HIGHEST for action port [ 884.487793] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_rules [ 884.487992] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 884.490976] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961fddb2-a7cf-4208-91ee-d22a91eaf355 with Priority: HIGHEST for action port [ 884.490976] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.490976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.490976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.490976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.490976] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.490976] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.490976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.491587] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-961fddb2-a7cf-4208-91ee-d22a91eaf355 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.491587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-961fddb2-a7cf-4208-91ee-d22a91eaf355" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.491587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-961fddb2-a7cf-4208-91ee-d22a91eaf355" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.491587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-961fddb2-a7cf-4208-91ee-d22a91eaf355" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.491708] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961fddb2-a7cf-4208-91ee-d22a91eaf355',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.993580] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.994271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.994271] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 961fddb2-a7cf-4208-91ee-d22a91eaf355 with status ACTIVE [ 884.994271] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.994271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.994271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.995370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.995370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.995370] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.995370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.995370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.995370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.995370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.995370] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.995666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.995666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.995666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.995860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.995860] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 961fddb2-a7cf-4208-91ee-d22a91eaf355 is going to be updated. [ 885.019771] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.019917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.019986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.020246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.020398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.020566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-961fddb2-a7cf-4208-91ee-d22a91eaf355" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.394486] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 in Status: SUCCESS [ 885.394707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.394884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.395121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.395341] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.395466] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.395533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.395688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.395762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.395842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.395932] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed7cc46a-1914-49e3-8b7d-d67e2682c5f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.784641] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: SUCCESS [ 885.784860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.898481] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.898644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.898724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.898956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.899156] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.899262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.899328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.900015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.900130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.900227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.900390] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.900488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.900551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.900694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.900863] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.900978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.901071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.901229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.901308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.901392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.901485] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed7cc46a-1914-49e3-8b7d-d67e2682c5f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.398020] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 886.399018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.399018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.399018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.399018] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.399018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.399018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.399474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.399474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.399474] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.404637] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed7cc46a-1914-49e3-8b7d-d67e2682c5f6: rpc.has_security_group_logging(os_id): False [ 886.428286] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.428439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.428510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.428828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.428883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.429103] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.429176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.429235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.429395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.429477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.429673] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.429805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.429857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.429956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.430039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.430233] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.430377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.430408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.430540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.430611] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.430698] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 is going to be created. [ 886.533204] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.533204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.533204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.533204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.533204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.552028] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 in Status: IN_PROGRESS for 2s [ 886.902356] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.405772] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.908581] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.908745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.908815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.909059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.909154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.909255] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 887.945371] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.945371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.945371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.947362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.947362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.958748] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 888.570289] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 in Status: SUCCESS [ 888.570639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.489936] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 889.490108] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 889.970466] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 889.970716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.970849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.971199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.971406] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.971574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.971644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.971815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.971911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.971999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.972306] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.314323] env[65553]: INFO networking_nsxv3.common.synchronization [req-abfdde6c-d837-4dcf-9e37-b8726ea9a304 req-a3573872-b80f-49ee-b0da-5549aa61df38 tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 890.314975] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 890.315315] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.315503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.315609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.315886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.316271] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.316403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.316479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.316663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.316734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.316836] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.474973] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.475171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.475246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.475469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.475705] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.475842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.475888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.476339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.476339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.476936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.477154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.477283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.477348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.477529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.477697] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.477796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.477869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.478138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.478138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.480010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.480010] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.819364] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.819609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.819693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.819903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.819997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.820235] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.820337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.820411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.820605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.820723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.820972] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 890.868761] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.868947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.869062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.870976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.875057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.885851] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 890.981675] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c96c798-8819-41b0-9168-410c415c2391: rpc.has_security_group_logging(os_id): False [ 891.000918] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.001199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.001301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.001559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.025877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.026176] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.026354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.026446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.026726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.026726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.026887] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.026985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.027063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.027212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.027286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.027473] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.027575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.027622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.027781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.027831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.027914] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 891.091254] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.091398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.091467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.091682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.091822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.105084] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 891.140620] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f41808ff-09d1-4a0f-8ae7-477c86a3cd5c None None] Enqueued Resource ID: 0fa76aba-004a-4b51-ac5f-ca19461e4815 with Priority: HIGHEST for action port [ 891.141196] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fa76aba-004a-4b51-ac5f-ca19461e4815 with Priority: HIGHEST for action port [ 891.141570] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fa76aba-004a-4b51-ac5f-ca19461e4815 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.141663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fa76aba-004a-4b51-ac5f-ca19461e4815" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.141693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fa76aba-004a-4b51-ac5f-ca19461e4815" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.141961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fa76aba-004a-4b51-ac5f-ca19461e4815" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.143400] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fa76aba-004a-4b51-ac5f-ca19461e4815',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.648592] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fa76aba-004a-4b51-ac5f-ca19461e4815 [ 891.648592] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.648592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.648592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.648592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.648592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.648592] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fa76aba-004a-4b51-ac5f-ca19461e4815 already deleted. [ 891.648592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fa76aba-004a-4b51-ac5f-ca19461e4815" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.910247] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 892.910247] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 deletion is rescheduled due to dependency. [ 892.910247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.125368] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 893.125589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.935492] env[65553]: INFO networking_nsxv3.common.synchronization [req-8a1e3c01-ce8e-4429-963e-30875c1037a9 req-a99dc347-8c00-4302-bdb3-eeb3d00496c0 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 893.935841] env[65553]: INFO networking_nsxv3.common.synchronization [req-8a1e3c01-ce8e-4429-963e-30875c1037a9 req-a99dc347-8c00-4302-bdb3-eeb3d00496c0 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGHEST for action security_group_members [ 893.935841] env[65553]: INFO networking_nsxv3.common.synchronization [req-8a1e3c01-ce8e-4429-963e-30875c1037a9 req-a99dc347-8c00-4302-bdb3-eeb3d00496c0 tempest-SecurityGroupsTestJSON-1263304096 tempest-SecurityGroupsTestJSON-1263304096-project-member] Enqueued Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_members [ 893.936289] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGHEST for action security_group_members [ 893.936623] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGHEST for action security_group_members [ 893.936623] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGHEST for action security_group_members [ 893.938381] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.938381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.938381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.939864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.940140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.940335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.940335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.941210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.941210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.941210] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.941645] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b16119-4a62-4859-895e-b0f3732128ff taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.942081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.942081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.942081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.942263] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.942263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.942263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.942425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.944064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.944064] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.947028] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.947208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.947569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.947786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.947961] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.948075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.948162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.948341] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.948422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.948471] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.234485] env[65553]: INFO networking_nsxv3.common.synchronization [None req-eeb84563-2c35-4164-9e1f-fca97bf17370 None None] Enqueued Resource ID: fc1aba9d-0d99-44eb-8b30-776c061ed53a with Priority: HIGHEST for action port [ 894.234952] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc1aba9d-0d99-44eb-8b30-776c061ed53a with Priority: HIGHEST for action port [ 894.235327] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc1aba9d-0d99-44eb-8b30-776c061ed53a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.235786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc1aba9d-0d99-44eb-8b30-776c061ed53a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.235786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc1aba9d-0d99-44eb-8b30-776c061ed53a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.235786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc1aba9d-0d99-44eb-8b30-776c061ed53a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.236131] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc1aba9d-0d99-44eb-8b30-776c061ed53a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.450919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.451083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.451083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.451301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.452462] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.452562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.452793] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.452876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.471206] env[65553]: INFO networking_nsxv3.common.synchronization [req-7b304e45-1b10-446e-a27a-716f193fa5a5 req-45b2d950-b7c1-4e6c-9e7d-7fca1c5f3b6a tempest-ImagesOneServerNegativeTestJSON-967710394 tempest-ImagesOneServerNegativeTestJSON-967710394-project-member] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 894.471870] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 894.472188] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.472302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.472365] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.472722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.472722] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.472833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.472833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.472981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.474241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.474241] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.476020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.476358] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.476516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.476611] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.476827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.476933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.477069] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b16119-4a62-4859-895e-b0f3732128ff is going to be updated. [ 894.479371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.479590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.479703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.480422] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.480576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.480668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.480944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.480998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.481104] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be updated. [ 894.482833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.482889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.504302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.505533] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.505740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.506067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.506537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.506660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.506798] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 330e4cbb-c145-4a73-968c-26c6765a2388 is going to be updated. [ 894.516134] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.516357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.516419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.516643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.516832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.519496] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.519628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.519760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.519908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.520094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.533020] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: IN_PROGRESS for 2s [ 894.533020] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b16119-4a62-4859-895e-b0f3732128ff in Status: IN_PROGRESS for 2s [ 894.542808] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.542931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.542969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.543868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.544298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.555429] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: IN_PROGRESS for 2s [ 894.740026] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc1aba9d-0d99-44eb-8b30-776c061ed53a [ 894.740026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.740026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.740026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.740296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.740296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.740296] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc1aba9d-0d99-44eb-8b30-776c061ed53a already deleted. [ 894.740886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc1aba9d-0d99-44eb-8b30-776c061ed53a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.983721] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.984023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.984023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.985875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.985875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.985875] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.985875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.985875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.985875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.985875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.985875] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be updated. [ 895.023537] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.023707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.023766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.025122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.025122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.041170] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: IN_PROGRESS for 2s [ 895.309991] env[65553]: INFO networking_nsxv3.common.synchronization [req-de16fe4b-3fc1-4b69-bd52-3004447b5140 req-710d2a6d-cccf-437f-9897-f1dc22c11c73 tempest-ListImageFiltersTestJSON-1822898395 tempest-ListImageFiltersTestJSON-1822898395-project-member] Enqueued Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 895.309991] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 with Priority: HIGHEST for action security_group_members [ 895.309991] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.309991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.309991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.309991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.309991] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.310651] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.311647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.311758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.311758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.311947] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ba6400-0dc9-4a80-ad83-aeeb3037ae85',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.817386] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.817386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.817386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.817386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.840951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.840951] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.840951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.840951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.840951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.840951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.840951] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 is going to be updated. [ 895.875066] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.875066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.875066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.875066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.875066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.885253] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: IN_PROGRESS for 2s [ 896.542753] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86c04db-ddf8-419d-8a90-125d10e637f6 in Status: SUCCESS [ 896.542753] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 deletion is rescheduled due to dependency. [ 896.542753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.543536] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b16119-4a62-4859-895e-b0f3732128ff in Status: SUCCESS [ 896.543724] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b16119-4a62-4859-895e-b0f3732128ff deletion is rescheduled due to dependency. [ 896.543828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.566422] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 330e4cbb-c145-4a73-968c-26c6765a2388 in Status: SUCCESS [ 896.566888] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 330e4cbb-c145-4a73-968c-26c6765a2388 deletion is rescheduled due to dependency. [ 896.567090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.054244] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: SUCCESS [ 897.054436] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 deletion is rescheduled due to dependency. [ 897.054500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.475418] env[65553]: INFO networking_nsxv3.common.synchronization [req-d252366d-afbc-4f9d-a1d3-f8c2e5b70e3e req-6a4d1abc-5497-45dd-9e55-c6254c5d7b1e tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_members [ 897.476070] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_members [ 897.476687] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.476687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.476687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.476937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.477251] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.477371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.477436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.477601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.477688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.477783] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.502097] env[65553]: INFO networking_nsxv3.common.synchronization [req-41b37cf6-03e6-4927-8b25-682de6dcecda req-7aa43b37-933c-4e82-84e4-eb2978bf706e tempest-ImagesTestJSON-1118693169 tempest-ImagesTestJSON-1118693169-project-member] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 897.502642] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 897.503495] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.503667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.503736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.504142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.504347] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.504463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.504543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.504745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.504837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.504940] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.897698] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 in Status: SUCCESS [ 897.898020] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ba6400-0dc9-4a80-ad83-aeeb3037ae85 deletion is rescheduled due to dependency. [ 897.898099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ba6400-0dc9-4a80-ad83-aeeb3037ae85" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.914538] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.914727] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.914848] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.915138] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.915391] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.915547] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.915698] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.915869] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.916013] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.917278] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.917278] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.917278] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.917278] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.917278] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.917278] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.917278] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.942125] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.942125] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 897.942301] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.942410] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.942738] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.942901] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.943026] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.943390] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.943526] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.980109] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.980283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.980356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.980622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.980735] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.980956] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.981066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.981128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.981811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.981811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.981811] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d already deleted. [ 897.981811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.007422] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.007931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.009221] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.009498] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.037643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.037643] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.037643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.037643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.037905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.037905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.037905] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 898.071615] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.071778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.071856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.072202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.072381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.085347] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 898.445996] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.446438] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.446693] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.447092] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.447355] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.447655] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c not found, creating... [ 898.448057] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.448357] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.448572] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.448963] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.449207] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.451190] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.451190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.451190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.451190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.451190] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.451190] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c is going to be created. [ 898.473438] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.473801] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.473933] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.474400] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.474723] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.474952] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.190282] env[65553]: INFO networking_nsxv3.common.synchronization [req-dc130847-9f09-410a-93bf-6a6bf19a887e req-927008fc-74d2-4ab6-9623-9aee34e83375 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 899.191963] env[65553]: INFO networking_nsxv3.common.synchronization [req-dc130847-9f09-410a-93bf-6a6bf19a887e req-927008fc-74d2-4ab6-9623-9aee34e83375 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f with Priority: HIGHEST for action security_group_members [ 899.193794] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 899.196277] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f with Priority: HIGHEST for action security_group_members [ 899.196277] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.196277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.196277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.196277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.196277] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.196277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.196277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.198699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.198699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.198823] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.203804] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.203804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.203804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.203804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.203804] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.203804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.203804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.203804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.203804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.203804] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8bc0c3-3908-4479-a37b-93bd2f93d42f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.213749] env[65553]: INFO networking_nsxv3.common.synchronization [req-d252366d-afbc-4f9d-a1d3-f8c2e5b70e3e req-47d3b3d9-d7c5-47d3-b98f-9d399673120c service nova] Enqueued Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_rules [ 899.213903] env[65553]: INFO networking_nsxv3.common.synchronization [req-d252366d-afbc-4f9d-a1d3-f8c2e5b70e3e req-47d3b3d9-d7c5-47d3-b98f-9d399673120c service nova] Enqueued Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_members [ 899.213932] env[65553]: INFO networking_nsxv3.common.synchronization [req-d252366d-afbc-4f9d-a1d3-f8c2e5b70e3e req-47d3b3d9-d7c5-47d3-b98f-9d399673120c service nova] Enqueued Resource ID: d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c with Priority: HIGHEST for action port [ 899.214780] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_rules [ 899.214780] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_members [ 899.214928] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c with Priority: HIGHEST for action port [ 899.218098] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.218269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.218367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.218742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.218862] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.224385] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.224582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.225036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.225127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.225311] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.225529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.226033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.226033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.226033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.226132] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.227343] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.227493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.227540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.227677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.227748] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.279402] env[65553]: INFO networking_nsxv3.common.synchronization [req-dc130847-9f09-410a-93bf-6a6bf19a887e req-927008fc-74d2-4ab6-9623-9aee34e83375 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f with Priority: HIGHEST for action security_group_rules [ 899.279945] env[65553]: INFO networking_nsxv3.common.synchronization [req-dc130847-9f09-410a-93bf-6a6bf19a887e req-927008fc-74d2-4ab6-9623-9aee34e83375 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f with Priority: HIGHEST for action security_group_members [ 899.279945] env[65553]: INFO networking_nsxv3.common.synchronization [req-dc130847-9f09-410a-93bf-6a6bf19a887e req-927008fc-74d2-4ab6-9623-9aee34e83375 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_rules [ 899.280219] env[65553]: INFO networking_nsxv3.common.synchronization [req-dc130847-9f09-410a-93bf-6a6bf19a887e req-927008fc-74d2-4ab6-9623-9aee34e83375 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 899.280219] env[65553]: INFO networking_nsxv3.common.synchronization [req-dc130847-9f09-410a-93bf-6a6bf19a887e req-927008fc-74d2-4ab6-9623-9aee34e83375 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: c5a57c5d-701e-43cc-b700-4eb759bf6b11 with Priority: HIGHEST for action port [ 899.281040] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f with Priority: HIGHEST for action security_group_rules [ 899.281183] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_rules [ 899.281386] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5a57c5d-701e-43cc-b700-4eb759bf6b11 with Priority: HIGHEST for action port [ 899.281386] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f with Priority: HIGHEST for action security_group_members [ 899.281468] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 899.281794] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c8bc0c3-3908-4479-a37b-93bd2f93d42f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.281919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.282022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.282525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.282525] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c8bc0c3-3908-4479-a37b-93bd2f93d42f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.283318] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.283436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.283539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.283787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.283787] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.284732] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5a57c5d-701e-43cc-b700-4eb759bf6b11 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.284883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.284972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.285145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.285248] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a57c5d-701e-43cc-b700-4eb759bf6b11',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.289414] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.289414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.289414] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.289414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.708210] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.708862] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c8bc0c3-3908-4479-a37b-93bd2f93d42f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.729999] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.730204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.730467] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c with status ACTIVE [ 899.730715] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.730870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.730964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.735024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.735024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.735024] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.735024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.735024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.735024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.735024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.735024] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.735024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.735024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.735024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.735024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.735024] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c is going to be updated. [ 899.735709] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.763665] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.763781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.763856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.764105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.764270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.764447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8f58eb2-54fb-491f-9ab3-5acf29e8fa8c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.791058] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.791216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.791434] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5a57c5d-701e-43cc-b700-4eb759bf6b11 with status ACTIVE [ 899.791667] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.791746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.791779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.791989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.795658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.795917] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.796160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.796250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.796516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.796603] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.796819] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.796925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.796987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.797159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.797235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.797321] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5a57c5d-701e-43cc-b700-4eb759bf6b11 is going to be updated. [ 899.798581] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.798677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.836342] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.836342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.836342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.836695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.837675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.837675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.016065] env[65553]: INFO networking_nsxv3.common.synchronization [req-f91ec7f5-be42-48cc-a886-1226fb59a7e2 req-57b49298-776d-4c87-8be8-db57240a5272 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 900.016065] env[65553]: INFO networking_nsxv3.common.synchronization [req-f91ec7f5-be42-48cc-a886-1226fb59a7e2 req-57b49298-776d-4c87-8be8-db57240a5272 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f with Priority: HIGHEST for action security_group_members [ 900.016065] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 900.016650] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f with Priority: HIGHEST for action security_group_members [ 900.016650] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.016650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.016802] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.016802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.078028] env[65553]: INFO networking_nsxv3.common.synchronization [req-f91ec7f5-be42-48cc-a886-1226fb59a7e2 req-57b49298-776d-4c87-8be8-db57240a5272 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_rules [ 900.078028] env[65553]: INFO networking_nsxv3.common.synchronization [req-f91ec7f5-be42-48cc-a886-1226fb59a7e2 req-57b49298-776d-4c87-8be8-db57240a5272 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 900.078028] env[65553]: INFO networking_nsxv3.common.synchronization [req-f91ec7f5-be42-48cc-a886-1226fb59a7e2 req-57b49298-776d-4c87-8be8-db57240a5272 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: c5a57c5d-701e-43cc-b700-4eb759bf6b11 with Priority: HIGHEST for action port [ 900.078642] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_rules [ 900.078898] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 900.079105] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5a57c5d-701e-43cc-b700-4eb759bf6b11 with Priority: HIGHEST for action port [ 900.079640] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.079892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.082022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.082022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.082022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5a57c5d-701e-43cc-b700-4eb759bf6b11 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.082022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.082022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.082022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.082022] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5a57c5d-701e-43cc-b700-4eb759bf6b11',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.098369] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 900.098369] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 deletion is rescheduled due to dependency. [ 900.098369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.215485] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.215485] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c8bc0c3-3908-4479-a37b-93bd2f93d42f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.241470] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.304427] env[65553]: INFO networking_nsxv3.common.synchronization [req-299d5da8-4bc0-4f08-ba8f-cc99d5424e65 req-f46eed6c-b495-4458-b584-9fc28c62876c tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_members [ 900.304757] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_members [ 900.305201] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71eb658-afb5-408d-a69d-dac4485c2f2e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.305340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.305407] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.305670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.305829] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.305928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.305987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.306155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.306238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.306363] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.583768] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5a57c5d-701e-43cc-b700-4eb759bf6b11 with status ACTIVE [ 900.584124] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.584348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.584442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.584748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.584891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.585216] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.585380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.585480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.585727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.585850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.586151] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.586358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.586481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.586630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.586717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.586851] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5a57c5d-701e-43cc-b700-4eb759bf6b11 is going to be updated. [ 900.616386] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.616688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.616822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.617079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.617256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.617525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5a57c5d-701e-43cc-b700-4eb759bf6b11" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.719766] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.719988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.719988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.720232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.720342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.720487] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 is going to be updated. [ 900.722121] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.722281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.722336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.722593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.722689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.722816] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f is going to be created. [ 900.744655] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.744868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.744936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.747085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.747085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.747085] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d is going to be created. [ 900.788368] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.788571] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.788628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.788927] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.789107] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.804601] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f in Status: UNINITIALIZED for 2s [ 900.804601] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.804601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.804601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.804601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.804601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.808545] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.808545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.808545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.808545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.808545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.810852] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.817614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.817614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.817614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.817614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.817614] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.817614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.817614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.817614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.817614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.817614] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71eb658-afb5-408d-a69d-dac4485c2f2e already deleted. [ 900.817614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.822394] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.823188] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.823188] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.823188] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.823373] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.823545] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.823660] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.823989] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.824157] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.824389] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.824498] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.824608] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.824715] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.824884] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.824967] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.825130] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.826910] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: IN_PROGRESS for 2s [ 900.827936] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d in Status: UNINITIALIZED for 2s [ 900.853753] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.854010] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 900.854081] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.854266] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.854805] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-6db1b96d-7cd7-43b8-8bb4-c75b18445ab7 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.855007] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-6db1b96d-7cd7-43b8-8bb4-c75b18445ab7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.855143] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-6db1b96d-7cd7-43b8-8bb4-c75b18445ab7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.855497] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-6db1b96d-7cd7-43b8-8bb4-c75b18445ab7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.855661] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6db1b96d-7cd7-43b8-8bb4-c75b18445ab7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.359577] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.359964] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.360055] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.360482] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.360650] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.360814] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 6db1b96d-7cd7-43b8-8bb4-c75b18445ab7 not found, creating... [ 901.361127] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.361297] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.361416] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.361848] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.362098] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.362500] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.362620] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.362743] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.363045] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.363196] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.363378] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 6db1b96d-7cd7-43b8-8bb4-c75b18445ab7 is going to be created. [ 901.390021] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.390252] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.390385] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.390692] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.390924] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.391217] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-6db1b96d-7cd7-43b8-8bb4-c75b18445ab7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.131638] env[65553]: INFO networking_nsxv3.common.synchronization [req-299d5da8-4bc0-4f08-ba8f-cc99d5424e65 req-b4a02776-6f42-4377-86be-67595e9d3948 service nova] Enqueued Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_rules [ 902.131789] env[65553]: INFO networking_nsxv3.common.synchronization [req-299d5da8-4bc0-4f08-ba8f-cc99d5424e65 req-b4a02776-6f42-4377-86be-67595e9d3948 service nova] Enqueued Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_members [ 902.132053] env[65553]: INFO networking_nsxv3.common.synchronization [req-299d5da8-4bc0-4f08-ba8f-cc99d5424e65 req-b4a02776-6f42-4377-86be-67595e9d3948 service nova] Enqueued Resource ID: 6db1b96d-7cd7-43b8-8bb4-c75b18445ab7 with Priority: HIGHEST for action port [ 902.132518] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_rules [ 902.133991] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_members [ 902.134167] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db1b96d-7cd7-43b8-8bb4-c75b18445ab7 with Priority: HIGHEST for action port [ 902.136927] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d71eb658-afb5-408d-a69d-dac4485c2f2e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.136927] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.136927] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.136927] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.136927] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.136927] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71eb658-afb5-408d-a69d-dac4485c2f2e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.137209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.137209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.137303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.138080] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.138080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.138080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.138080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.138080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.138303] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.140751] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-6db1b96d-7cd7-43b8-8bb4-c75b18445ab7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.141028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6db1b96d-7cd7-43b8-8bb4-c75b18445ab7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.141028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6db1b96d-7cd7-43b8-8bb4-c75b18445ab7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.141546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6db1b96d-7cd7-43b8-8bb4-c75b18445ab7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.144211] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6db1b96d-7cd7-43b8-8bb4-c75b18445ab7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.541039] env[65553]: INFO networking_nsxv3.common.synchronization [req-8aae4e55-60d4-490b-9073-26eb77737bbb req-326a9e42-b822-4b83-9092-f5c526c5b56c tempest-AttachVolumeShelveTestJSON-653256025 tempest-AttachVolumeShelveTestJSON-653256025-project-member] Enqueued Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_members [ 902.541646] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_members [ 902.541981] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2ef9829-ef49-436a-a11a-bae751628c4a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.542127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.542188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.542458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.543538] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.543538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.543538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.543538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.543538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.543538] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.649154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71eb658-afb5-408d-a69d-dac4485c2f2e taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.649154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.649154] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.649154] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6db1b96d-7cd7-43b8-8bb4-c75b18445ab7 with status ACTIVE [ 902.649154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.649154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.649154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.649154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.649154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.649154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.649154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.649154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.649154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.649154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.649845] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.650186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.650369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.650618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.651776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.651776] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6db1b96d-7cd7-43b8-8bb4-c75b18445ab7 is going to be updated. [ 902.675996] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.676547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.676547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.676685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.676846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.676996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6db1b96d-7cd7-43b8-8bb4-c75b18445ab7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.815575] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f in Status: SUCCESS [ 902.817961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.817961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.817961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.817961] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.817961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.817961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.817961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.817961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.817961] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8bc0c3-3908-4479-a37b-93bd2f93d42f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.837682] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: SUCCESS [ 902.838117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.840017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.840017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.840017] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.840017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.840017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.840017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.840017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.840017] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.844155] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d in Status: SUCCESS [ 902.844155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.844155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.844155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.844155] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.844155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.844155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.844155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.844155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.844155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.845432] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.025394] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.025394] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.025394] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.025394] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.025394] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.025394] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.025394] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.026067] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.026416] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.026803] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.027069] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.027286] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.027578] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.029574] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.029574] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.029574] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.047238] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.047440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.047522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.047771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.047869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.048098] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.048207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.048272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.048424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.048502] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.048588] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2ef9829-ef49-436a-a11a-bae751628c4a already deleted. [ 903.048671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.049676] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.049884] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 903.050077] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.050233] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.050514] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-00569db8-de30-4ca9-a37a-2a0021c8a0ee taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.050670] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.050784] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.051060] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.051195] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00569db8-de30-4ca9-a37a-2a0021c8a0ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.153613] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.319244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.320390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.320469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.320693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.320781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.320988] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.321103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.321162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.321304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.321376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.321459] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f is going to be deleted. [ 903.344884] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.348321] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.356857] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.356857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.356857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.357074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.357154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.357273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.357457] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.357638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.357803] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.357900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.357960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.358118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.358188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.358280] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8bc0c3-3908-4479-a37b-93bd2f93d42f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.553847] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.554398] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.554478] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.554790] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.554980] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.555177] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 00569db8-de30-4ca9-a37a-2a0021c8a0ee not found, creating... [ 903.555467] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.555646] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.555767] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.556193] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.556483] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.557715] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.558059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.558308] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.558682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.558956] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.559274] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 00569db8-de30-4ca9-a37a-2a0021c8a0ee is going to be created. [ 903.586801] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.587074] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.587163] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.587530] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.587796] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.588112] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.656355] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.656586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.656619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.656815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.656923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.657044] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71eb658-afb5-408d-a69d-dac4485c2f2e is going to be created. [ 903.709303] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.709487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.709560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.709752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.709909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.727956] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71eb658-afb5-408d-a69d-dac4485c2f2e in Status: UNINITIALIZED for 2s [ 903.851260] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.851526] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d: rpc.has_security_group_logging(os_id): False [ 903.860988] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.861155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.861155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.861372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.861465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.861705] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.861827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.861895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.862059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.862141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.862228] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f already deleted. [ 903.862305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.862440] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c8bc0c3-3908-4479-a37b-93bd2f93d42f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.865481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.865680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.866160] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.866235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.866308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.866551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.866635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.867031] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c8bc0c3-3908-4479-a37b-93bd2f93d42f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.874560] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.874560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.874560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.874560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.874560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.875235] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.875371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.875435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.875609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.875684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.875772] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d is going to be created. [ 903.961631] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.963217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.963217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.963217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.963217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.984955] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d in Status: IN_PROGRESS for 2s [ 904.346202] env[65553]: INFO networking_nsxv3.common.synchronization [req-8aae4e55-60d4-490b-9073-26eb77737bbb req-2b3aff6f-6ac2-483f-9fdc-0eab84da0e11 service nova] Enqueued Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_rules [ 904.346202] env[65553]: INFO networking_nsxv3.common.synchronization [req-8aae4e55-60d4-490b-9073-26eb77737bbb req-2b3aff6f-6ac2-483f-9fdc-0eab84da0e11 service nova] Enqueued Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_members [ 904.346202] env[65553]: INFO networking_nsxv3.common.synchronization [req-8aae4e55-60d4-490b-9073-26eb77737bbb req-2b3aff6f-6ac2-483f-9fdc-0eab84da0e11 service nova] Enqueued Resource ID: 00569db8-de30-4ca9-a37a-2a0021c8a0ee with Priority: HIGHEST for action port [ 904.346833] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_rules [ 904.346984] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_members [ 904.347157] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00569db8-de30-4ca9-a37a-2a0021c8a0ee with Priority: HIGHEST for action port [ 904.347500] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2ef9829-ef49-436a-a11a-bae751628c4a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.347624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.347693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.347909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.348032] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.359119] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2ef9829-ef49-436a-a11a-bae751628c4a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.359119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.359119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.359119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.359119] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.359119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.359119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.359119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.359119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.359119] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.359630] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-00569db8-de30-4ca9-a37a-2a0021c8a0ee taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.359827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.359903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.360084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.360962] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00569db8-de30-4ca9-a37a-2a0021c8a0ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.361828] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.361903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.362563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.362563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.362563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.362563] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 is going to be updated. [ 904.369692] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c8bc0c3-3908-4479-a37b-93bd2f93d42f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.371233] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.371400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.373022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.373022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.373022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.373022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.373022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.373022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.373022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.373022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.373022] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f already deleted. [ 904.373022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.400761] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.400971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.401059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.403206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.403206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.415267] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: IN_PROGRESS for 2s [ 904.862054] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.862901] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2ef9829-ef49-436a-a11a-bae751628c4a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.863046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.864863] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00569db8-de30-4ca9-a37a-2a0021c8a0ee with status ACTIVE [ 904.865608] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.865608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.865608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.865827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.865929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.866147] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.866254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.866320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.866667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.866771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.866983] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.867105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.867180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.867337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.867488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.867582] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00569db8-de30-4ca9-a37a-2a0021c8a0ee is going to be updated. [ 904.874514] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c8bc0c3-3908-4479-a37b-93bd2f93d42f: rpc.has_security_group_logging(os_id): False [ 904.896513] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.896764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.896764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.896953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.897106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.897267] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.898718] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.898842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.898910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.899106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.899191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.899400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.899513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.899575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.899730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.899796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.899881] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f is going to be created. [ 904.920029] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1c8bc0c3-3908-4479-a37b-93bd2f93d42f], does not exist path=[/infra/domains/default/groups/1c8bc0c3-3908-4479-a37b-93bd2f93d42f]."\n}' [ 904.920189] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1c8bc0c3-3908-4479-a37b-93bd2f93d42f [ 904.920371] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 905.011145] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.011145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.011145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.011145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.011921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.012246] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.012381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.012433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.012589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.012663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.012869] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.012959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.013086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.013156] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.013223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.013302] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c8bc0c3-3908-4479-a37b-93bd2f93d42f is going to be created. [ 905.044162] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1c8bc0c3-3908-4479-a37b-93bd2f93d42f], does not exist path=[/infra/domains/default/groups/1c8bc0c3-3908-4479-a37b-93bd2f93d42f]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1c8bc0c3-3908-4479-a37b-93bd2f93d42f [ 905.044343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c8bc0c3-3908-4479-a37b-93bd2f93d42f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.044580] env[65553]: Traceback (most recent call last): [ 905.044634] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 905.044634] env[65553]: return func(*args, **kwargs) [ 905.044634] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 905.044634] env[65553]: res.raise_for_status() [ 905.044634] env[65553]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 905.044634] env[65553]: raise HTTPError(http_error_msg, response=self) [ 905.044634] env[65553]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1c8bc0c3-3908-4479-a37b-93bd2f93d42f [ 905.044634] env[65553]: During handling of the above exception, another exception occurred: [ 905.044634] env[65553]: Traceback (most recent call last): [ 905.044634] env[65553]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 905.044634] env[65553]: listener.cb(fileno) [ 905.044634] env[65553]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 905.044634] env[65553]: result = function(*args, **kwargs) [ 905.044634] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 905.044634] env[65553]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 905.044634] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 905.044634] env[65553]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 905.044634] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 905.044634] env[65553]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 905.044634] env[65553]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 905.044634] env[65553]: res.raise_for_status() [ 905.044634] env[65553]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 905.044634] env[65553]: raise HTTPError(http_error_msg, response=self) [ 905.045377] env[65553]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1c8bc0c3-3908-4479-a37b-93bd2f93d42f [ 905.045377] env[65553]: Removing descriptor: 23 [ 905.364151] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.411958] env[65553]: INFO networking_nsxv3.common.synchronization [req-247eabfb-9ed6-418d-a78b-119c4268d91b req-6ebe70ac-0829-48f4-8a43-a49515bb7a13 tempest-ServersV294TestFqdnHostnames-1467859160 tempest-ServersV294TestFqdnHostnames-1467859160-project-member] Enqueued Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_members [ 905.411958] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGHEST for action security_group_members [ 905.411958] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-510c04b8-85b7-4488-b4cf-5880529fe0b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.411958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.412445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.413027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.413333] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.413589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.413761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.415386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.415386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.415386] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.740257] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71eb658-afb5-408d-a69d-dac4485c2f2e in Status: SUCCESS [ 905.740504] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.741486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.741486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.741486] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.741486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.741486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.741719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.741719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.741769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.741836] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.867635] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.867953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.867953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.868134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.868228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.868353] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2ef9829-ef49-436a-a11a-bae751628c4a is going to be created. [ 905.901551] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.901704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.901771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.902101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.902360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.914489] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2ef9829-ef49-436a-a11a-bae751628c4a in Status: UNINITIALIZED for 2s [ 905.917891] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.918055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.918143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.918356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.944563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.944786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.944978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.944978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.945189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.945268] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.945373] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 is going to be updated. [ 905.984757] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.985081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.985081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.985205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.985356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.997564] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 in Status: IN_PROGRESS for 2s [ 906.002447] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d in Status: SUCCESS [ 906.002693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.244773] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.431702] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: SUCCESS [ 906.434035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.434035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.434035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.434035] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.434035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.434035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.434035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.434035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.434035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.434035] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.436515] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.438834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.439583] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.439583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.439583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.439583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.439583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.439583] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.749866] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d71eb658-afb5-408d-a69d-dac4485c2f2e: rpc.has_security_group_logging(os_id): False [ 906.781313] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.781512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.781564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.781818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.781949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.782384] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.782553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.782658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.782890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.783017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.783138] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d71eb658-afb5-408d-a69d-dac4485c2f2e is going to be created. [ 906.860484] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.860691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.860729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.861314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.861417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.878945] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d71eb658-afb5-408d-a69d-dac4485c2f2e in Status: IN_PROGRESS for 2s [ 906.937600] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.937778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.942752] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.445997] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.925970] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2ef9829-ef49-436a-a11a-bae751628c4a in Status: SUCCESS [ 907.926375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.926460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.926749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.926951] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.927086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.927151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.927412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.928054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.928054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.928054] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.949108] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.949275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.949423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.949596] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.949703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.949809] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 is going to be updated. [ 907.990102] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.990308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.990423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.990689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.990838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.007295] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: IN_PROGRESS for 2s [ 908.009023] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 in Status: SUCCESS [ 908.009290] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 deletion is rescheduled due to dependency. [ 908.009426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.431133] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.893699] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d71eb658-afb5-408d-a69d-dac4485c2f2e in Status: SUCCESS [ 908.894994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.933798] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2ef9829-ef49-436a-a11a-bae751628c4a: rpc.has_security_group_logging(os_id): False [ 908.955891] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.956152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.956256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.956586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.956708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.957043] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.957190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.957247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.957447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.957562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.957654] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2ef9829-ef49-436a-a11a-bae751628c4a is going to be created. [ 909.071807] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.072018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.072065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.072323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.072578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.087236] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2ef9829-ef49-436a-a11a-bae751628c4a in Status: IN_PROGRESS for 2s [ 909.612384] env[65553]: INFO networking_nsxv3.common.synchronization [req-d321be23-030f-48bc-8a67-58c892f2f578 req-d43ee1a1-e988-41bf-a6d6-f0f7aa6319de tempest-ServerGroupTestJSON-658237611 tempest-ServerGroupTestJSON-658237611-project-member] Enqueued Resource ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 with Priority: HIGHEST for action security_group_members [ 909.612897] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 with Priority: HIGHEST for action security_group_members [ 909.613310] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd4fd13-5d20-444e-a455-6722e01bb869 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.613443] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.613543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.613864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.614130] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.616206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.616300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.616559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.616691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.616798] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dd4fd13-5d20-444e-a455-6722e01bb869',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.991206] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.992886] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-877" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.993192] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-877" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.993683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-877" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.994161] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.994489] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.994680] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.995062] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.995298] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.995632] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.995806] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.996241] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.998623] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.998846] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.999040] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.002622] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.023859] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: SUCCESS [ 910.024168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.024419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.024592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.024788] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.024910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.024973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.025162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.025239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.025494] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.031763] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.031763] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.031763] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.031763] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-877" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.031763] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-1be1959b-1d4a-42cd-8d87-5cde704242d3 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.031763] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-1be1959b-1d4a-42cd-8d87-5cde704242d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.032213] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-1be1959b-1d4a-42cd-8d87-5cde704242d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.032213] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-1be1959b-1d4a-42cd-8d87-5cde704242d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.032355] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be1959b-1d4a-42cd-8d87-5cde704242d3',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.119596] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.119733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.119806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.120025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.120109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.120320] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.120431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.120474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.120640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.120716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.120821] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 already deleted. [ 910.120893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.528019] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.536825] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.536825] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.536825] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.536825] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.536825] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.537071] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 1be1959b-1d4a-42cd-8d87-5cde704242d3 not found, creating... [ 910.537317] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.537588] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.537750] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.538040] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.538212] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.538575] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.538788] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.538912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.539245] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.539404] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.539563] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 1be1959b-1d4a-42cd-8d87-5cde704242d3 is going to be created. [ 910.564964] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.565182] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.565265] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.565878] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.565878] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.566066] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-1be1959b-1d4a-42cd-8d87-5cde704242d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.030503] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.107658] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2ef9829-ef49-436a-a11a-bae751628c4a in Status: SUCCESS [ 911.107658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.313059] env[65553]: INFO networking_nsxv3.common.synchronization [req-d321be23-030f-48bc-8a67-58c892f2f578 req-3d50f345-fb86-4c9f-9c79-4d927f44440a service nova] Enqueued Resource ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 with Priority: HIGHEST for action security_group_rules [ 911.313265] env[65553]: INFO networking_nsxv3.common.synchronization [req-d321be23-030f-48bc-8a67-58c892f2f578 req-3d50f345-fb86-4c9f-9c79-4d927f44440a service nova] Enqueued Resource ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 with Priority: HIGHEST for action security_group_members [ 911.313403] env[65553]: INFO networking_nsxv3.common.synchronization [req-d321be23-030f-48bc-8a67-58c892f2f578 req-3d50f345-fb86-4c9f-9c79-4d927f44440a service nova] Enqueued Resource ID: 1be1959b-1d4a-42cd-8d87-5cde704242d3 with Priority: HIGHEST for action port [ 911.313999] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 with Priority: HIGHEST for action security_group_rules [ 911.314834] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 with Priority: HIGHEST for action security_group_members [ 911.314834] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be1959b-1d4a-42cd-8d87-5cde704242d3 with Priority: HIGHEST for action port [ 911.315147] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dd4fd13-5d20-444e-a455-6722e01bb869 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.315301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.315378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.315666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.315747] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dd4fd13-5d20-444e-a455-6722e01bb869',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.316866] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd4fd13-5d20-444e-a455-6722e01bb869 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.316866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.316990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.317096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.317244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.317344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.317408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.317566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.317667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.317758] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dd4fd13-5d20-444e-a455-6722e01bb869',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.318642] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be1959b-1d4a-42cd-8d87-5cde704242d3 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.318769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be1959b-1d4a-42cd-8d87-5cde704242d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.318826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be1959b-1d4a-42cd-8d87-5cde704242d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.319212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be1959b-1d4a-42cd-8d87-5cde704242d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.319212] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be1959b-1d4a-42cd-8d87-5cde704242d3',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.532626] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.534193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.534380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.534731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.534919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.535031] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 is going to be updated. [ 911.572233] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.572400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.572464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.572685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.572824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.584465] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: IN_PROGRESS for 2s [ 911.821331] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd4fd13-5d20-444e-a455-6722e01bb869 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.821506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.821990] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dd4fd13-5d20-444e-a455-6722e01bb869',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.824941] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1be1959b-1d4a-42cd-8d87-5cde704242d3 with status ACTIVE [ 911.825551] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.825690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.826510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.826510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.826510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.826640] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.826692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.826965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.827250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.827379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.827613] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.827748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.827819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.828225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.828225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.828225] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1be1959b-1d4a-42cd-8d87-5cde704242d3 is going to be updated. [ 911.857131] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.857376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.857376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.857564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.857704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.857879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be1959b-1d4a-42cd-8d87-5cde704242d3" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.231716] env[65553]: INFO networking_nsxv3.common.synchronization [req-c5d036ce-84bf-4909-9fd9-4f8add437079 req-a2dd2027-440b-4299-a7b7-8ef74cab422a tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 912.233409] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 912.234084] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.234544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.234544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.234852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.235315] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.235426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.235601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.235955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.236192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.236500] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.329937] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dd4fd13-5d20-444e-a455-6722e01bb869',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.520158] env[65553]: INFO networking_nsxv3.common.synchronization [req-d8863703-03e1-4509-b0fc-93e614a0e293 req-1aadbf44-f510-4738-a216-07eb35d25458 tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 912.521205] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 912.522714] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.523043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.523289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.523574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.523820] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.524388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.524550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.524872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.525142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.526220] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.550302] env[65553]: INFO networking_nsxv3.common.synchronization [req-3a446a0e-9734-496d-92e4-41cf020086db req-0b302484-d2d7-4cbf-b4c2-2558b9a561b2 tempest-ServerRescueTestJSONUnderV235-947453004 tempest-ServerRescueTestJSONUnderV235-947453004-project-member] Enqueued Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 912.552265] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 with Priority: HIGHEST for action security_group_members [ 912.552608] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.552725] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.741736] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.741963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.741963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.742892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.742892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.742892] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.742892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.742892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.742892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.742892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.742892] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be deleted. [ 912.773040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.773262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.773262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.773423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.773515] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.773702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.832304] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.832304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.832304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.832483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.832555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.832658] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 is going to be created. [ 912.874589] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.874819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.874819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.875013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.875180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.887612] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 in Status: UNINITIALIZED for 2s [ 912.901036] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.901036] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.901230] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.901348] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.901599] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.901780] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.901895] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.902132] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.902276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.902515] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.902639] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.902698] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.902805] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.902904] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.903011] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.903143] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.924776] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.924776] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.924776] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.925089] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.925172] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-4fec9b98-a003-44b5-b61b-dcbb7d57a00e taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.925348] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-4fec9b98-a003-44b5-b61b-dcbb7d57a00e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.925462] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-4fec9b98-a003-44b5-b61b-dcbb7d57a00e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.925783] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-4fec9b98-a003-44b5-b61b-dcbb7d57a00e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.925950] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fec9b98-a003-44b5-b61b-dcbb7d57a00e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.981335] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.981522] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.981644] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.981985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.982263] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.982427] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.982544] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.982763] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.982903] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.983130] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.983241] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.983345] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.983449] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.983554] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.983654] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.983789] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.002914] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.003067] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.003181] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.003352] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.003717] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.003894] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.004021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.004337] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.004480] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.029193] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.029366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.029447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.029696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.055162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.055408] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.055575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.055728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.055988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.056130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.056347] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 913.081108] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.081307] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.081307] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.081512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.081654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.092637] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 913.428242] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.428627] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.428627] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.428917] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.429082] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.429241] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 4fec9b98-a003-44b5-b61b-dcbb7d57a00e not found, creating... [ 913.429501] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.429660] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.429775] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.429991] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.430167] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.430447] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.430705] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.430841] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.431061] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.431194] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.431331] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 4fec9b98-a003-44b5-b61b-dcbb7d57a00e is going to be created. [ 913.455797] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.456067] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.456131] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.456391] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.456660] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.456890] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-4fec9b98-a003-44b5-b61b-dcbb7d57a00e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.506989] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.507234] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.507362] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.507738] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.507927] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.508103] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd not found, creating... [ 913.508394] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.508623] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.508790] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.509107] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.509327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.509714] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.509915] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.510051] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.510268] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.510455] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.510610] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd is going to be created. [ 913.543683] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.543951] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.544132] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.544504] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.544780] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.545065] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.595875] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: SUCCESS [ 913.596145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.596342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.596605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.596836] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.596981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.597079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.597272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.597361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.597501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.597747] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac09d86f-1825-444d-b8fe-6cf1e194fce1 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.597891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.597989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.598186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.598401] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.598543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.598606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.598818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.598892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.598975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.599078] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.599949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.600125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.600276] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.600374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.600440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.600583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.600654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.600918] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.102764] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac09d86f-1825-444d-b8fe-6cf1e194fce1: rpc.has_security_group_logging(os_id): False [ 914.104251] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.104485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.104585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.104896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.123854] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.124073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.126958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.127209] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.127318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.127388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.127619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.127706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.127798] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 is going to be updated. [ 914.128805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.129033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.129154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.129383] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.129510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.129588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.129739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.129834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.130089] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.130224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.130289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.130456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.130541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.130738] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.130848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.130910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.131095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.131179] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.131276] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 is going to be updated. [ 914.163717] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.163717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.163928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.163963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.164126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.174330] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: IN_PROGRESS for 2s [ 914.194522] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.194522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.194522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.194795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.194969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.204396] env[65553]: INFO networking_nsxv3.common.synchronization [req-c5d036ce-84bf-4909-9fd9-4f8add437079 req-4a396f78-ea9e-4134-8ffd-53104f226bbe service nova] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_rules [ 914.204449] env[65553]: INFO networking_nsxv3.common.synchronization [req-c5d036ce-84bf-4909-9fd9-4f8add437079 req-4a396f78-ea9e-4134-8ffd-53104f226bbe service nova] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 914.204726] env[65553]: INFO networking_nsxv3.common.synchronization [req-c5d036ce-84bf-4909-9fd9-4f8add437079 req-4a396f78-ea9e-4134-8ffd-53104f226bbe service nova] Enqueued Resource ID: 4fec9b98-a003-44b5-b61b-dcbb7d57a00e with Priority: HIGHEST for action port [ 914.205199] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_rules [ 914.205333] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 914.205432] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fec9b98-a003-44b5-b61b-dcbb7d57a00e with Priority: HIGHEST for action port [ 914.205715] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.205854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.205932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.206273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.206359] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.207516] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.207643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.207734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.207921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.212431] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.212431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.212431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.212431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.212431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.212431] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.212431] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fec9b98-a003-44b5-b61b-dcbb7d57a00e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.212431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fec9b98-a003-44b5-b61b-dcbb7d57a00e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.212431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fec9b98-a003-44b5-b61b-dcbb7d57a00e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.212966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fec9b98-a003-44b5-b61b-dcbb7d57a00e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.212966] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fec9b98-a003-44b5-b61b-dcbb7d57a00e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.215489] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: IN_PROGRESS for 2s [ 914.272495] env[65553]: INFO networking_nsxv3.common.synchronization [req-d8863703-03e1-4509-b0fc-93e614a0e293 req-0a294edb-952e-49e6-8fb7-1ae7c0bb00c0 service nova] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_rules [ 914.272495] env[65553]: INFO networking_nsxv3.common.synchronization [req-d8863703-03e1-4509-b0fc-93e614a0e293 req-0a294edb-952e-49e6-8fb7-1ae7c0bb00c0 service nova] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 914.272495] env[65553]: INFO networking_nsxv3.common.synchronization [req-d8863703-03e1-4509-b0fc-93e614a0e293 req-0a294edb-952e-49e6-8fb7-1ae7c0bb00c0 service nova] Enqueued Resource ID: ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd with Priority: HIGHEST for action port [ 914.272495] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_rules [ 914.273668] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 914.274025] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd with Priority: HIGHEST for action port [ 914.275081] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.276800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.276800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.276800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.276800] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.279059] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.279059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.279059] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.279059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.279059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.279059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.279059] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.715644] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.715644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.715644] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.716639] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fec9b98-a003-44b5-b61b-dcbb7d57a00e with status ACTIVE [ 914.716972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.717178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.717252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.717563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.717699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.717980] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.718102] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.718174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.718368] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.718449] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.718673] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.718806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.718887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.719235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.719235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.719235] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fec9b98-a003-44b5-b61b-dcbb7d57a00e is going to be updated. [ 914.751911] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.752125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.752197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.752432] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.752586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.752761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fec9b98-a003-44b5-b61b-dcbb7d57a00e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.778201] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.778358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.781754] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd with status ACTIVE [ 914.782008] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.782170] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.782258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.782501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.782597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.782827] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.782951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.783015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.783216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.783302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.783512] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.783614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.783694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.783855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.783938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.784040] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd is going to be updated. [ 914.815292] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.815292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.815292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.815292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.815292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.815292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab97cb3b-f78f-4a43-95f3-0d6b4289e2bd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.007722] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 in Status: SUCCESS [ 915.007937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.008156] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.008391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.008589] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.008709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.008782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.008949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.009064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.009165] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.009260] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dd4fd13-5d20-444e-a455-6722e01bb869',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.108633] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 915.108872] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 deletion is rescheduled due to dependency. [ 915.109022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.109202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.109418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.109662] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.109816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.109888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.110117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.110219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.110341] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.221431] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.514564] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd4fd13-5d20-444e-a455-6722e01bb869 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.516105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.516301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.516823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.517541] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.517866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.518439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.518698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.518846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.518956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.519215] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd4fd13-5d20-444e-a455-6722e01bb869 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.519811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.519906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.520505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.520707] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.520819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.520888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.521072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.521144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.521225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.521317] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dd4fd13-5d20-444e-a455-6722e01bb869',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.615480] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.727570] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.727944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.727944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.728083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.728175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.728273] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be created. [ 915.759308] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.760655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.760655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.760655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.760655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.771430] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: UNINITIALIZED for 2s [ 916.028306] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dd4fd13-5d20-444e-a455-6722e01bb869: rpc.has_security_group_logging(os_id): False [ 916.049065] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.049343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.049343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.049522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.049623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.049797] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.049923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.049982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.050122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.050208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.050405] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.050521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.050582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.050721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.050803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.050964] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.051067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.051152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.051281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.051345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.051430] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 is going to be created. [ 916.116931] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.117181] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.117181] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.117436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.117566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.118675] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.132810] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 in Status: IN_PROGRESS for 2s [ 916.203071] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: SUCCESS [ 916.203385] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 deletion is rescheduled due to dependency. [ 916.203578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.234445] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 in Status: SUCCESS [ 916.235508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.235873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.236619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.236841] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac09d86f-1825-444d-b8fe-6cf1e194fce1',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.621434] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.621669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.621804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.622152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.622314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.622458] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 916.661859] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.662078] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.662364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.662364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.662504] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.675312] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 916.760763] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.763020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.763020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.763020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.763020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.763020] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac09d86f-1825-444d-b8fe-6cf1e194fce1 is going to be deleted. [ 916.835146] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.835146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.835146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.837896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.837896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.837896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac09d86f-1825-444d-b8fe-6cf1e194fce1" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.322345] env[65553]: INFO networking_nsxv3.common.synchronization [req-4c17c7f4-0295-4ce0-bacd-03018e72762b req-f818a51c-12b3-4c15-a6c7-6a92326bf4de tempest-ServerRescueTestJSON-981888117 tempest-ServerRescueTestJSON-981888117-project-member] Enqueued Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 917.322945] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 917.323273] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.323392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.323457] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.323708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.323866] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.323967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.325605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.325837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.325937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.326125] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.783768] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 917.784124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.784235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.784471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.784687] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.784810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.784950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.785189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.785189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.785280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.785313] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.828123] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.828275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.828338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.828560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.828654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.828847] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.828943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.829013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.829165] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.829239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.829415] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b already deleted. [ 917.829415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.153810] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 in Status: SUCCESS [ 918.154061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.196484] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.196851] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-506" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.196960] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-506" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.197444] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-506" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.197938] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.198226] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.198358] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.198590] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.198731] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.199054] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.199171] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.199274] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.199434] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.199485] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.199584] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.199717] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.223440] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.223639] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 918.223725] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.223975] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-506" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.224423] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-e18fd397-d44e-423e-beba-ca2dee687d4e taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.224791] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-e18fd397-d44e-423e-beba-ca2dee687d4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.224941] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-e18fd397-d44e-423e-beba-ca2dee687d4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.225955] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-e18fd397-d44e-423e-beba-ca2dee687d4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.226059] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e18fd397-d44e-423e-beba-ca2dee687d4e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.291378] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.291378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.291660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.292130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.292130] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.292130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.292130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.292340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.292409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.292519] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.292674] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.292763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.292819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.292958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.294488] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.294488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.294488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.294488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.294488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.294488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.294488] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.686128] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 918.686359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.686577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.686815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.687026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.687154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.687287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.687382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.687494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.687565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.687658] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.730209] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.730209] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.730209] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.730468] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.730988] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.730988] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port e18fd397-d44e-423e-beba-ca2dee687d4e not found, creating... [ 918.731152] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.731237] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.731351] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.731852] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.731852] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.732035] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.732222] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.732364] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.732884] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.732954] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.733177] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: e18fd397-d44e-423e-beba-ca2dee687d4e is going to be created. [ 918.758855] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.759767] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.759767] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.759767] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.759767] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.760035] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-e18fd397-d44e-423e-beba-ca2dee687d4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.796586] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4ee4c50-7cd1-464f-8791-a617053e06f6: rpc.has_security_group_logging(os_id): False [ 918.821705] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.821990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.822256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.822499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.822628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.822942] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.823287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.823382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.823770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.823770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.824040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.824192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.825692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.825692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.825692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.825692] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.825692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.825692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.825692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.825692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.826575] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be created. [ 918.929381] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.929901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.929901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.929901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.930254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.964068] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 919.191617] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.192043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.192043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.192198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.193274] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.193274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.193274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.193274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.193274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.193274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.193274] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.193600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.193600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.193949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.193949] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.194060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.194093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.194261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.194396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.194441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.194764] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.594983] env[65553]: INFO networking_nsxv3.common.synchronization [req-4c17c7f4-0295-4ce0-bacd-03018e72762b req-f03db8bd-7b1b-419f-aa5c-59d303a08a9b service nova] Enqueued Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_rules [ 919.594983] env[65553]: INFO networking_nsxv3.common.synchronization [req-4c17c7f4-0295-4ce0-bacd-03018e72762b req-f03db8bd-7b1b-419f-aa5c-59d303a08a9b service nova] Enqueued Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 919.594983] env[65553]: INFO networking_nsxv3.common.synchronization [req-4c17c7f4-0295-4ce0-bacd-03018e72762b req-f03db8bd-7b1b-419f-aa5c-59d303a08a9b service nova] Enqueued Resource ID: e18fd397-d44e-423e-beba-ca2dee687d4e with Priority: HIGHEST for action port [ 919.595360] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_rules [ 919.595604] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 919.595730] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e18fd397-d44e-423e-beba-ca2dee687d4e with Priority: HIGHEST for action port [ 919.597392] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.598820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.598820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.598820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.598820] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.600653] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.602337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.602337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.602337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.602337] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.602337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.602337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.602337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.602337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.602770] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.603789] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e18fd397-d44e-423e-beba-ca2dee687d4e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.603921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e18fd397-d44e-423e-beba-ca2dee687d4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.603989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e18fd397-d44e-423e-beba-ca2dee687d4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.604197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e18fd397-d44e-423e-beba-ca2dee687d4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.604263] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e18fd397-d44e-423e-beba-ca2dee687d4e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.701090] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60f68fd-25de-4d38-bc93-3e4066ff8aa6: rpc.has_security_group_logging(os_id): False [ 919.727122] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.727122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.727122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.727122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.727122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.727571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.728801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.728801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.728801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.728801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.728801] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.728801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.728801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.728801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.729133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.729133] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.729208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.729240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.729460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.729460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.729536] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 919.869212] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.869212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.869643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.869643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.869702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.886145] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 920.107886] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.107886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.107886] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.108764] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e18fd397-d44e-423e-beba-ca2dee687d4e with status ACTIVE [ 920.108946] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.109080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.109155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.109352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.109507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.109598] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.109687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.109746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.109886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.111739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.111739] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.111739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.111739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.111739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.111739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.111739] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e18fd397-d44e-423e-beba-ca2dee687d4e is going to be updated. [ 920.139532] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.139731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.139731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.139947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.140094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.140258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e18fd397-d44e-423e-beba-ca2dee687d4e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.612436] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.813117] env[65553]: INFO networking_nsxv3.common.synchronization [None req-41c43f3a-5bd7-4070-921b-5b6dfffef1b4 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 920.813117] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 920.813117] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.813117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.813117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.813709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.814036] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.815280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.815280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.815955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.816725] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.816725] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.981260] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 920.981603] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.118100] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.118426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.118519] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.118816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.118939] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.119138] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b is going to be created. [ 921.148841] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.149128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.149240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.149741] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.150032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.167399] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: UNINITIALIZED for 2s [ 921.319213] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.823502] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.908789] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 921.909029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.326026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.326324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.326389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.326675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.326887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.327090] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 922.363858] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.364066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.364175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.364487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.364703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.376419] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 923.180839] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: SUCCESS [ 923.183047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.183047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.183047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.183047] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.183047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.183047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.184429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.184729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.186127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.186127] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.415178] env[65553]: INFO networking_nsxv3.common.synchronization [req-21b94857-2bd4-4599-bf27-b6ee09ce3239 req-517e2168-1c0f-4be2-b63d-f76b88cf8136 tempest-MigrationsAdminTest-418950081 tempest-MigrationsAdminTest-418950081-project-member] Enqueued Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 923.416839] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 923.417280] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.417402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.417475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.417718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.417882] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.417993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.418080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.418262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.418351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.418452] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.688766] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.688766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.688766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.689111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.689111] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.691031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.691031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.691031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.691031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.691265] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.691265] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.691349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.691484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.691570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.691701] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.691788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.691844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.691984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.692066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.692153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.692241] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.782808] env[65553]: INFO networking_nsxv3.common.synchronization [req-3dd071a8-3320-4e4c-84d6-eda27e60ddf1 req-e743f29e-0c26-4d60-bd27-9ec16e7f7ffb tempest-ImagesTestJSON-1118693169 tempest-ImagesTestJSON-1118693169-project-member] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 923.783446] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 923.783764] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.783891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.783960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.786054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.786222] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.786375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.786453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.786900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.786975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.787795] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.921895] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.117747] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.117960] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.118107] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.118458] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.118797] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.118997] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.124266] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.124549] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.124705] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.124921] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.125050] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.125161] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.125269] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.125376] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.125479] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.125613] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.138226] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-939 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.138412] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.138571] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.139134] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.139134] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.139470] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.139470] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.139768] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.139856] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.140174] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.140243] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.140323] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.140487] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.140549] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.140676] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.140824] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.149030] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.149030] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.149232] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.149336] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.149640] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-ac2f7155-3238-4c85-a3ee-bbcfede72f30 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.149815] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-ac2f7155-3238-4c85-a3ee-bbcfede72f30" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.149942] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-ac2f7155-3238-4c85-a3ee-bbcfede72f30" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.150774] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-ac2f7155-3238-4c85-a3ee-bbcfede72f30" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.150774] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac2f7155-3238-4c85-a3ee-bbcfede72f30',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.160677] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.160677] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.160677] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.160885] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-939" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.161087] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-9cc7b705-4f84-4b26-a474-567a6bbb63da taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.161271] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-9cc7b705-4f84-4b26-a474-567a6bbb63da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.161390] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-9cc7b705-4f84-4b26-a474-567a6bbb63da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.161732] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-9cc7b705-4f84-4b26-a474-567a6bbb63da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.161864] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc7b705-4f84-4b26-a474-567a6bbb63da',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.195661] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c60427c8-0bdd-4ef0-a14a-b6e54b6e072b: rpc.has_security_group_logging(os_id): False [ 924.214746] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.214964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.215092] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.215329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.215420] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.215669] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.215770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.215832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.215989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.216089] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.216384] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.216565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.216775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.216855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.216989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.217283] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.217404] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.217478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.217651] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.217739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.217795] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b is going to be created. [ 924.284546] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.284546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.284546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.284546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.284546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.289453] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.289840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.290038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.290844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.304016] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: IN_PROGRESS for 2s [ 924.317950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.318227] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.318350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.318417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.318627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.318712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.318814] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 924.350360] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.350624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.350624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.350784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.350865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.363255] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 924.390340] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 924.390608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.423813] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.652550] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.652804] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.652948] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.653323] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.653485] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.653651] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port ac2f7155-3238-4c85-a3ee-bbcfede72f30 not found, creating... [ 924.653928] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.654116] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.654282] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.654637] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.654780] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.655188] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.655368] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.655655] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.655775] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.655836] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.656072] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: ac2f7155-3238-4c85-a3ee-bbcfede72f30 is going to be created. [ 924.664746] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.664977] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.665094] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.665392] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.665543] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.665686] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 9cc7b705-4f84-4b26-a474-567a6bbb63da not found, creating... [ 924.665982] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.666125] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.666239] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.666467] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.666633] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.666972] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.667234] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.667357] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.667683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.667850] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.667997] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 9cc7b705-4f84-4b26-a474-567a6bbb63da is going to be created. [ 924.679834] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.680121] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.680316] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.680639] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.680947] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.681322] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-ac2f7155-3238-4c85-a3ee-bbcfede72f30" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.705245] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.705593] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.705593] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.706044] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.707098] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.707098] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-9cc7b705-4f84-4b26-a474-567a6bbb63da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.928177] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.928177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.928177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.928177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.928177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.928177] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 is going to be updated. [ 924.964150] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.964472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.964472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.964631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.964893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.975587] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: IN_PROGRESS for 2s [ 925.401537] env[65553]: INFO networking_nsxv3.common.synchronization [req-3dd071a8-3320-4e4c-84d6-eda27e60ddf1 req-e7766629-108a-4365-a97c-879ccc08d913 service nova] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_rules [ 925.401733] env[65553]: INFO networking_nsxv3.common.synchronization [req-3dd071a8-3320-4e4c-84d6-eda27e60ddf1 req-e7766629-108a-4365-a97c-879ccc08d913 service nova] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 925.401966] env[65553]: INFO networking_nsxv3.common.synchronization [req-3dd071a8-3320-4e4c-84d6-eda27e60ddf1 req-e7766629-108a-4365-a97c-879ccc08d913 service nova] Enqueued Resource ID: 9cc7b705-4f84-4b26-a474-567a6bbb63da with Priority: HIGHEST for action port [ 925.402719] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_rules [ 925.402914] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 925.402968] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc7b705-4f84-4b26-a474-567a6bbb63da with Priority: HIGHEST for action port [ 925.403291] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.403417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.403482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.405059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.405059] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.405059] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.405059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.405059] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cc7b705-4f84-4b26-a474-567a6bbb63da taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.405059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cc7b705-4f84-4b26-a474-567a6bbb63da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.405382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cc7b705-4f84-4b26-a474-567a6bbb63da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.405382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cc7b705-4f84-4b26-a474-567a6bbb63da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.405382] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc7b705-4f84-4b26-a474-567a6bbb63da',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.409152] env[65553]: INFO networking_nsxv3.common.synchronization [req-91c1484c-bc34-4c4e-9885-5d7e1a22ff7c req-187b336b-02d6-4982-8171-94bcdb6617ff service nova] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_rules [ 925.409152] env[65553]: INFO networking_nsxv3.common.synchronization [req-91c1484c-bc34-4c4e-9885-5d7e1a22ff7c req-187b336b-02d6-4982-8171-94bcdb6617ff service nova] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 925.409152] env[65553]: INFO networking_nsxv3.common.synchronization [req-91c1484c-bc34-4c4e-9885-5d7e1a22ff7c req-187b336b-02d6-4982-8171-94bcdb6617ff service nova] Enqueued Resource ID: ac2f7155-3238-4c85-a3ee-bbcfede72f30 with Priority: HIGHEST for action port [ 925.409152] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_rules [ 925.409152] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 925.409603] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac2f7155-3238-4c85-a3ee-bbcfede72f30 with Priority: HIGHEST for action port [ 925.410084] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.410192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.410469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.410469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.410575] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.411293] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.411441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.411493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.411639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.411799] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.411910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.412008] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.412203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.412292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.412408] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.417421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac2f7155-3238-4c85-a3ee-bbcfede72f30 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.417421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac2f7155-3238-4c85-a3ee-bbcfede72f30" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.417421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac2f7155-3238-4c85-a3ee-bbcfede72f30" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.417421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac2f7155-3238-4c85-a3ee-bbcfede72f30" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.417421] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac2f7155-3238-4c85-a3ee-bbcfede72f30',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.907885] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.908256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.910563] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cc7b705-4f84-4b26-a474-567a6bbb63da with status ACTIVE [ 925.910811] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.910952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.911032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.911268] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.911394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.911555] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.911663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.911996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.912068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.912234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.912427] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.912560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.912617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.912851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.912942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.913073] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cc7b705-4f84-4b26-a474-567a6bbb63da is going to be updated. [ 925.917106] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.917241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.917837] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.921327] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac2f7155-3238-4c85-a3ee-bbcfede72f30 with status ACTIVE [ 925.921327] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.921327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.921454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.921587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.921670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.921837] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.922110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.922110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.922194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.922258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.922453] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.922543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.922600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.923155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.923155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.923155] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac2f7155-3238-4c85-a3ee-bbcfede72f30 is going to be updated. [ 925.949616] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.949788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.949859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.950103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.950241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.950478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cc7b705-4f84-4b26-a474-567a6bbb63da" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.978681] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.978969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.979087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.979329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.979467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.979628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac2f7155-3238-4c85-a3ee-bbcfede72f30" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.323956] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: SUCCESS [ 926.324233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.375113] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 926.376050] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 deletion is rescheduled due to dependency. [ 926.376050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.376050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.376050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.376253] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.376382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.376480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.376811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.376957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.377210] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.420420] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.881555] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.925612] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.925612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.925612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.925612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.925612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.925612] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 926.966377] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.966549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.966614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.966894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.967147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.983924] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 926.986775] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: SUCCESS [ 926.986968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.385067] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.888481] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.888645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.888742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.889018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.889122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.889244] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 927.917831] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.918258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.918258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.918258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.918425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.931165] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 928.997755] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 928.998168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.998219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.998522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.998797] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.999022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.999120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.001583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.001583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.001583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.001583] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.502644] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.502837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.502886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.503825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.503825] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.503825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.503825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.503825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.503825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.504182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.504182] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.504254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.504307] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.504421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.504591] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.504734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.504820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.505027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.505125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.505211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.505317] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.948475] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 929.948817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.949057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.950201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.950426] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.950620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.951128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.951128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.951242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.951337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.951457] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.008983] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4ee4c50-7cd1-464f-8791-a617053e06f6: rpc.has_security_group_logging(os_id): False [ 930.031648] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.031967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.031967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.032442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.032442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.032806] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.032806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.032975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.034164] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.034263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.034526] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.034617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.034686] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.034850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.034929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.035229] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.035339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.035339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.035465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.035539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.035619] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 930.117083] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.118858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.118979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.119203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.119359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.135640] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 930.410892] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 930.414365] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 930.458281] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.458281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.458281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.458579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.459029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.459029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.459029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.459240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.459240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.459400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.459546] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.459654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.459712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.459863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.460077] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.460238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.460292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.460402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.460478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.460613] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.460670] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.534032] env[65553]: INFO networking_nsxv3.common.synchronization [None req-b29f0c7d-52a9-425e-8bfa-1268f3667aa9 None None] Enqueued Resource ID: f549755f-1710-4391-b0ee-d262f51a2916 with Priority: HIGHEST for action port [ 930.534740] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f549755f-1710-4391-b0ee-d262f51a2916 with Priority: HIGHEST for action port [ 930.536367] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-f549755f-1710-4391-b0ee-d262f51a2916 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.536367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f549755f-1710-4391-b0ee-d262f51a2916" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.536574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f549755f-1710-4391-b0ee-d262f51a2916" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.537358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f549755f-1710-4391-b0ee-d262f51a2916" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.537506] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f549755f-1710-4391-b0ee-d262f51a2916',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.965884] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15032a54-f6e7-41b8-855b-0262e8fb39c5: rpc.has_security_group_logging(os_id): False [ 930.988470] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.988635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.988702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.990429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.990429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.990429] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.990429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.990429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.990429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.990664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.990697] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.991079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.991179] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.991335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.991494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.991723] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.991866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.991984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.992165] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.992257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.992364] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 931.042069] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f549755f-1710-4391-b0ee-d262f51a2916 [ 931.042412] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.042655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.042758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.043172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.043301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.043431] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f549755f-1710-4391-b0ee-d262f51a2916 already deleted. [ 931.043553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f549755f-1710-4391-b0ee-d262f51a2916" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.065064] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.065064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.065064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.065064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.065064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.087040] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 931.474810] env[65553]: INFO networking_nsxv3.common.synchronization [req-5641fed2-ef98-44db-a675-e6d952e3aa74 req-6a1fd38c-617c-4cc3-a4ff-3caab1c6e28c tempest-ServerGroupTestJSON-658237611 tempest-ServerGroupTestJSON-658237611-project-member] Enqueued Resource ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 with Priority: HIGHEST for action security_group_members [ 931.478776] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 with Priority: HIGHEST for action security_group_members [ 931.479443] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dd4fd13-5d20-444e-a455-6722e01bb869 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.479655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.479764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.480117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.480328] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.481531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.481635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.481825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.481925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.482098] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dd4fd13-5d20-444e-a455-6722e01bb869',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.985614] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.986225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.986225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.986313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.986455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.987083] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.991440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.991440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.991440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.991440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.991440] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 is going to be updated. [ 932.022024] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.022206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.022612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.022612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.022758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.037103] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 in Status: IN_PROGRESS for 2s [ 932.155063] env[65553]: INFO networking_nsxv3.common.synchronization [None req-bff90a0b-7e05-40ca-9d5e-fdf220cafb33 None None] Enqueued Resource ID: bbf557e2-f5b8-45aa-af9d-7906c740a0ce with Priority: HIGHEST for action port [ 932.155788] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 932.156056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.156696] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf557e2-f5b8-45aa-af9d-7906c740a0ce with Priority: HIGHEST for action port [ 932.157195] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbf557e2-f5b8-45aa-af9d-7906c740a0ce taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.157195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbf557e2-f5b8-45aa-af9d-7906c740a0ce" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.157292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbf557e2-f5b8-45aa-af9d-7906c740a0ce" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.157599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbf557e2-f5b8-45aa-af9d-7906c740a0ce" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.157695] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf557e2-f5b8-45aa-af9d-7906c740a0ce',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.664513] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbf557e2-f5b8-45aa-af9d-7906c740a0ce [ 932.664736] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.664842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.664903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.665158] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.665275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.665340] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbf557e2-f5b8-45aa-af9d-7906c740a0ce already deleted. [ 932.666043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbf557e2-f5b8-45aa-af9d-7906c740a0ce" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.678266] env[65553]: INFO networking_nsxv3.common.synchronization [None req-39f8a08a-d477-48e3-bdfe-2420a0218b6d tempest-ServersTestManualDisk-575149513 tempest-ServersTestManualDisk-575149513-project-member] Enqueued Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_rules [ 932.678266] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_rules [ 932.678266] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a088526-39aa-4b85-a4b7-780ad374c69e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.678266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.678266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.678266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.678266] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.836627] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d43822a1-4aa8-4821-b493-6c60ab99143e tempest-ServersTestManualDisk-575149513 tempest-ServersTestManualDisk-575149513-project-member] Enqueued Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_rules [ 932.837286] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_rules [ 932.838918] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a088526-39aa-4b85-a4b7-780ad374c69e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.839045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.106479] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 933.106479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.208195] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.208490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.208490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.208643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.208731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.208831] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a088526-39aa-4b85-a4b7-780ad374c69e already deleted. [ 933.208914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.209094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.209250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.209332] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.740359] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.741711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.741711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.741711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.741711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.741711] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a088526-39aa-4b85-a4b7-780ad374c69e already deleted. [ 933.741711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.048253] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 in Status: SUCCESS [ 934.048541] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 deletion is rescheduled due to dependency. [ 934.048689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.094911] env[65553]: INFO networking_nsxv3.common.synchronization [None req-281a44bc-cf48-4238-bc4b-4ed3bf3f0bdd tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_rules [ 935.096214] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_rules [ 935.096214] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.096349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.096349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.096686] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.096686] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.623062] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.623480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.623480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.623716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.623865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.624056] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 already deleted. [ 935.624184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.734434] env[65553]: INFO networking_nsxv3.common.synchronization [None req-dea128bd-902c-45ca-b24c-f519393e4cf2 tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_rules [ 935.735129] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_rules [ 935.735556] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.735746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.735854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.736204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.736393] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.750632] env[65553]: INFO networking_nsxv3.common.synchronization [None req-83566a8c-b60a-4bb8-a7cb-aeb9fc881644 None None] Enqueued Resource ID: 68229124-199a-4e2e-bff8-158bcbad3f0b with Priority: HIGHEST for action port [ 935.751431] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68229124-199a-4e2e-bff8-158bcbad3f0b with Priority: HIGHEST for action port [ 935.751788] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-68229124-199a-4e2e-bff8-158bcbad3f0b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.751975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68229124-199a-4e2e-bff8-158bcbad3f0b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.752124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68229124-199a-4e2e-bff8-158bcbad3f0b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.752420] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68229124-199a-4e2e-bff8-158bcbad3f0b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.752563] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68229124-199a-4e2e-bff8-158bcbad3f0b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.254617] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68229124-199a-4e2e-bff8-158bcbad3f0b [ 936.254983] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.255278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.255278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.255577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.256514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.256514] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68229124-199a-4e2e-bff8-158bcbad3f0b already deleted. [ 936.256514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68229124-199a-4e2e-bff8-158bcbad3f0b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.263690] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.263690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.263690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.263690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.264079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.264079] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 already deleted. [ 936.264141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.625290] env[65553]: INFO networking_nsxv3.common.synchronization [req-9f8b90e4-a637-4d3b-a433-d977f183261f req-de806aa0-6eb1-413e-a6df-b2c0e5b9086c tempest-ImagesOneServerNegativeTestJSON-967710394 tempest-ImagesOneServerNegativeTestJSON-967710394-project-member] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 937.627919] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 937.627919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.629330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.629864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.632060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.632060] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.632060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.632060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.632060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.632060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.632060] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.919478] env[65553]: INFO networking_nsxv3.common.synchronization [None req-06dc9ae0-d2b7-486b-9d2b-4a51bb0d0d72 None None] Enqueued Resource ID: a5075b47-3e07-4453-ae1c-23ca1c31a1c9 with Priority: HIGHEST for action port [ 937.919904] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5075b47-3e07-4453-ae1c-23ca1c31a1c9 with Priority: HIGHEST for action port [ 937.920310] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5075b47-3e07-4453-ae1c-23ca1c31a1c9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.920422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5075b47-3e07-4453-ae1c-23ca1c31a1c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.920889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5075b47-3e07-4453-ae1c-23ca1c31a1c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.921222] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5075b47-3e07-4453-ae1c-23ca1c31a1c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.921332] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5075b47-3e07-4453-ae1c-23ca1c31a1c9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.137731] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.137872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.137959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.138218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.162370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.162579] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.162701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.162769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.162971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.163075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.163162] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be updated. [ 938.193523] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.193676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.193749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.193997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.194163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.204477] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: IN_PROGRESS for 2s [ 938.424196] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5075b47-3e07-4453-ae1c-23ca1c31a1c9 [ 938.424852] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.424852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.425270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.425849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.425849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.425849] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5075b47-3e07-4453-ae1c-23ca1c31a1c9 already deleted. [ 938.425849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5075b47-3e07-4453-ae1c-23ca1c31a1c9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.463024] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-236 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.463024] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.463024] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.463024] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.464535] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.464535] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.464535] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.464535] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.467889] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.467889] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.467889] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.467889] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.467889] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.467889] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.467889] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.467889] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.486024] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.486224] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 938.486366] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.486536] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-236" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.488058] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-d5a87c2f-e115-4bf5-ac6f-49f21d88f024 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.488058] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-d5a87c2f-e115-4bf5-ac6f-49f21d88f024" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.488058] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-d5a87c2f-e115-4bf5-ac6f-49f21d88f024" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.488058] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-d5a87c2f-e115-4bf5-ac6f-49f21d88f024" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.488058] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5a87c2f-e115-4bf5-ac6f-49f21d88f024',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.990257] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.990772] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.990772] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.990854] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.991017] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.991177] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port d5a87c2f-e115-4bf5-ac6f-49f21d88f024 not found, creating... [ 938.991451] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.991608] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.991727] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.991958] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.992121] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.992413] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.993449] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.993554] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.994831] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.994831] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.994831] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: d5a87c2f-e115-4bf5-ac6f-49f21d88f024 is going to be created. [ 939.020272] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.020272] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.020272] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.020425] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.020629] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.020865] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-d5a87c2f-e115-4bf5-ac6f-49f21d88f024" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.881856] env[65553]: INFO networking_nsxv3.common.synchronization [req-9f8b90e4-a637-4d3b-a433-d977f183261f req-537eccd3-b08e-421c-b3d8-36c04f95961a service nova] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_rules [ 939.882039] env[65553]: INFO networking_nsxv3.common.synchronization [req-9f8b90e4-a637-4d3b-a433-d977f183261f req-537eccd3-b08e-421c-b3d8-36c04f95961a service nova] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 939.882178] env[65553]: INFO networking_nsxv3.common.synchronization [req-9f8b90e4-a637-4d3b-a433-d977f183261f req-537eccd3-b08e-421c-b3d8-36c04f95961a service nova] Enqueued Resource ID: d5a87c2f-e115-4bf5-ac6f-49f21d88f024 with Priority: HIGHEST for action port [ 939.882409] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_rules [ 939.882536] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 939.882631] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a87c2f-e115-4bf5-ac6f-49f21d88f024 with Priority: HIGHEST for action port [ 939.883696] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.883819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.883911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.884207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.884289] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.885197] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.885294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.886209] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5a87c2f-e115-4bf5-ac6f-49f21d88f024 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.886209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5a87c2f-e115-4bf5-ac6f-49f21d88f024" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.886209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5a87c2f-e115-4bf5-ac6f-49f21d88f024" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.886209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5a87c2f-e115-4bf5-ac6f-49f21d88f024" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.886209] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5a87c2f-e115-4bf5-ac6f-49f21d88f024',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.218024] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: SUCCESS [ 940.218024] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 deletion is rescheduled due to dependency. [ 940.218024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.218024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.218024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.218024] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.218024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.218024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.218940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.219252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.219570] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.389697] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.389871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.390025] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5a87c2f-e115-4bf5-ac6f-49f21d88f024 with status ACTIVE [ 940.390261] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.390380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.390448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.390673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.390860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.391089] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.391250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.391250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.391445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.391554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.391710] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.391812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.391870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.392029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.392104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.392186] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5a87c2f-e115-4bf5-ac6f-49f21d88f024 is going to be updated. [ 940.426555] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.426840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.426905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.429088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.429088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.429088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5a87c2f-e115-4bf5-ac6f-49f21d88f024" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.725666] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.231159] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.734317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.734513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.734600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.734873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.734961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.735090] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be updated. [ 941.769546] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.769763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.769763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.769997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.770186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.781036] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: IN_PROGRESS for 2s [ 942.491524] env[65553]: INFO networking_nsxv3.common.synchronization [None req-5066fb2d-cd5a-4784-bc7d-dc04e89fc320 None None] Enqueued Resource ID: cd07c9d9-5ae4-496f-9542-547ee9375555 with Priority: HIGHEST for action port [ 942.492219] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd07c9d9-5ae4-496f-9542-547ee9375555 with Priority: HIGHEST for action port [ 942.492530] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd07c9d9-5ae4-496f-9542-547ee9375555 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.492662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd07c9d9-5ae4-496f-9542-547ee9375555" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.492733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd07c9d9-5ae4-496f-9542-547ee9375555" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.493028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd07c9d9-5ae4-496f-9542-547ee9375555" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.493110] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd07c9d9-5ae4-496f-9542-547ee9375555',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.693982] env[65553]: INFO networking_nsxv3.common.synchronization [None req-a66f6c82-4f82-4ad3-8c3c-c2812e85c42b tempest-AttachVolumeTestJSON-579631701 tempest-AttachVolumeTestJSON-579631701-project-member] Enqueued Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_rules [ 942.694751] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_rules [ 942.697552] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb67cc18-9ceb-429a-844d-a60317217b7b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.697552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.697552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.698256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.698486] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.863987] env[65553]: INFO networking_nsxv3.common.synchronization [None req-e448a15d-49f3-44d5-a29b-764f213736d0 tempest-AttachVolumeTestJSON-579631701 tempest-AttachVolumeTestJSON-579631701-project-member] Enqueued Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_rules [ 942.864628] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_rules [ 942.864948] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb67cc18-9ceb-429a-844d-a60317217b7b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.865217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.995424] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd07c9d9-5ae4-496f-9542-547ee9375555 [ 942.995703] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.995853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.996030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.996209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.996313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.996427] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd07c9d9-5ae4-496f-9542-547ee9375555 already deleted. [ 942.996573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd07c9d9-5ae4-496f-9542-547ee9375555" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.229062] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.229280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.229280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.229612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.229724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.229821] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb67cc18-9ceb-429a-844d-a60317217b7b already deleted. [ 943.229904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.230486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.230486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.230486] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.723033] env[65553]: INFO networking_nsxv3.common.synchronization [None req-9ef0d981-470a-41b9-898e-8f2a9aa0dac8 None None] Enqueued Resource ID: 3aba4b67-048f-4079-9eaa-30e5767752ee with Priority: HIGHEST for action port [ 943.723033] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aba4b67-048f-4079-9eaa-30e5767752ee with Priority: HIGHEST for action port [ 943.723033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-3aba4b67-048f-4079-9eaa-30e5767752ee taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.723033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3aba4b67-048f-4079-9eaa-30e5767752ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.723033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3aba4b67-048f-4079-9eaa-30e5767752ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.723033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3aba4b67-048f-4079-9eaa-30e5767752ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.723033] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aba4b67-048f-4079-9eaa-30e5767752ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.756737] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.756915] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.756986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.761033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.761033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.761033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb67cc18-9ceb-429a-844d-a60317217b7b already deleted. [ 943.761033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.793062] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: SUCCESS [ 943.793335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.793498] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.793732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.793954] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.794110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.794175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.794328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.794409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.794495] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.794965] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.044174] env[65553]: INFO networking_nsxv3.common.synchronization [req-f6006563-1ea6-44e7-979d-88b4c00670bc req-26332a87-0c62-4065-b889-c8d6b929e565 tempest-ServersAdminTestJSON-844759989 tempest-ServersAdminTestJSON-844759989-project-member] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 944.044908] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 944.046509] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.046739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.046739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.047118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.047296] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.047372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.047875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.048143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.048278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.048415] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.231199] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3aba4b67-048f-4079-9eaa-30e5767752ee [ 944.231199] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.231199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.231199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.231199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.231199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.231199] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3aba4b67-048f-4079-9eaa-30e5767752ee already deleted. [ 944.231199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3aba4b67-048f-4079-9eaa-30e5767752ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.298649] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.302728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.302728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.302728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.302728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.303419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.303419] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.552162] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.805308] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d069dc70-d382-4790-b884-3c9bf5e88eb0: rpc.has_security_group_logging(os_id): False [ 944.838976] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.839160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.839200] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.839738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.839738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.839869] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.839997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.840087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.840239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.840415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.842042] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.842178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.842237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.842554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.842554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.842666] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.843120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.843120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.843120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.844277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.845333] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be updated. [ 944.889782] env[65553]: INFO networking_nsxv3.common.synchronization [req-77f5c943-67a7-43e8-a3f3-a00b0c469176 req-2b6cd502-e653-4ea6-b595-fd768dcf4994 tempest-ServersTestManualDisk-575149513 tempest-ServersTestManualDisk-575149513-project-member] Enqueued Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_members [ 944.894731] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_members [ 944.895185] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a088526-39aa-4b85-a4b7-780ad374c69e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.895373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.895411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.895682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.895853] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.895995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.896090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.896574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.896574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.896574] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.964478] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.964478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.964478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.964478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.964478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.982116] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: IN_PROGRESS for 2s [ 945.053828] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.302354] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-816 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.302482] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-816" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.302565] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-816" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.302938] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-816" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.306469] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.308141] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.309361] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.309361] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.309361] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.309361] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.309361] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.309510] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.309540] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.309638] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.309941] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.309941] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.332076] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.332249] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.332998] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.332998] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-816" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.332998] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-cd858826-cf88-4284-9461-8c134390133f taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.333219] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-cd858826-cf88-4284-9461-8c134390133f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.333337] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-cd858826-cf88-4284-9461-8c134390133f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.334094] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-cd858826-cf88-4284-9461-8c134390133f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.334234] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd858826-cf88-4284-9461-8c134390133f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.400147] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.401116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.401116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.401305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.402434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.402434] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.402434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.402434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.402434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.402434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.402434] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a088526-39aa-4b85-a4b7-780ad374c69e already deleted. [ 945.403186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.525845] env[65553]: INFO networking_nsxv3.common.synchronization [req-5a885d81-9e27-463d-bd01-15c2a84d667a req-a572562e-5aed-403d-959a-7debf71eee4a tempest-MigrationsAdminTest-418950081 tempest-MigrationsAdminTest-418950081-project-member] Enqueued Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 945.526445] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGHEST for action security_group_members [ 945.526813] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.526944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.528101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.528424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.528683] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.528892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.528987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.529253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.529560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.529730] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.557728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.557998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.558213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.558472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.558760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.559340] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 945.602974] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.603199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.603281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.603971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.603971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.615024] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 945.839434] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.839832] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.839832] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.840529] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.840833] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.842246] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port cd858826-cf88-4284-9461-8c134390133f not found, creating... [ 945.842246] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.842246] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.842246] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.843316] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.843316] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.843316] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.843316] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.845212] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.845212] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.845212] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.845212] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: cd858826-cf88-4284-9461-8c134390133f is going to be created. [ 945.873173] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.873499] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.873622] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.873912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.874611] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.874899] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-cd858826-cf88-4284-9461-8c134390133f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.032803] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.033053] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.033150] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.033438] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.069012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.069411] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.069964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.070159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.070493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.070595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.070717] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 is going to be updated. [ 946.126940] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.127112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.127184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.127430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.127574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.141072] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: IN_PROGRESS for 2s [ 946.722105] env[65553]: INFO networking_nsxv3.common.synchronization [req-77f5c943-67a7-43e8-a3f3-a00b0c469176 req-f4b1124d-2d43-41ea-bc1b-90ed969c3a16 service nova] Enqueued Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_rules [ 946.722105] env[65553]: INFO networking_nsxv3.common.synchronization [req-77f5c943-67a7-43e8-a3f3-a00b0c469176 req-f4b1124d-2d43-41ea-bc1b-90ed969c3a16 service nova] Enqueued Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_members [ 946.722105] env[65553]: INFO networking_nsxv3.common.synchronization [req-77f5c943-67a7-43e8-a3f3-a00b0c469176 req-f4b1124d-2d43-41ea-bc1b-90ed969c3a16 service nova] Enqueued Resource ID: cd858826-cf88-4284-9461-8c134390133f with Priority: HIGHEST for action port [ 946.722105] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_rules [ 946.722105] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_members [ 946.722105] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd858826-cf88-4284-9461-8c134390133f with Priority: HIGHEST for action port [ 946.722105] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a088526-39aa-4b85-a4b7-780ad374c69e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.722105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.722105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.723295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.723295] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.727157] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a088526-39aa-4b85-a4b7-780ad374c69e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.727280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.727358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.727541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.727726] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.727864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.727864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.727989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.728151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.728151] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.729154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd858826-cf88-4284-9461-8c134390133f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.729154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd858826-cf88-4284-9461-8c134390133f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.729318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd858826-cf88-4284-9461-8c134390133f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.729373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd858826-cf88-4284-9461-8c134390133f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.729446] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd858826-cf88-4284-9461-8c134390133f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.019233] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: SUCCESS [ 947.019713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.183877] env[65553]: INFO networking_nsxv3.common.synchronization [req-50a017e5-7cb2-4b29-88f5-112b5cf38813 req-27de348d-f2e5-47b7-8f05-97757f41e110 tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 947.188501] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 947.188501] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.188501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.188501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.188501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.188501] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.188501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.188501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.188501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.188501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.188501] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.233890] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.627709] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 947.629410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.688672] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.688891] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-363" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.689046] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-363" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.689441] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-363" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.690897] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.691177] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.691283] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.691524] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.691662] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.691885] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.692015] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.692118] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.692223] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.692330] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.692435] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.692565] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.694168] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.694275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.694311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.694678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.694678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.694871] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.694993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.695091] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.695287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.695492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.695492] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 already deleted. [ 947.695580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.716191] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.716585] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.716585] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.716585] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-363" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.717114] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-12e38a72-0ece-480e-ba69-6d43bb17ff6a taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.717286] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.717286] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.717766] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.717938] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e38a72-0ece-480e-ba69-6d43bb17ff6a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.734493] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a088526-39aa-4b85-a4b7-780ad374c69e taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.734828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.735573] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd858826-cf88-4284-9461-8c134390133f with status ACTIVE [ 947.735818] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.735958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.736011] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.736227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.736321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.736521] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.736619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.736726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.736922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.737044] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.737309] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.737482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.737533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.737722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.737841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.738113] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd858826-cf88-4284-9461-8c134390133f is going to be updated. [ 947.739990] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.772454] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.772737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.772883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.773312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.773499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.773702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd858826-cf88-4284-9461-8c134390133f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.157385] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 in Status: SUCCESS [ 948.157961] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 deletion is rescheduled due to dependency. [ 948.157961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.220686] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.221298] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.221298] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.221440] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.221500] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.221699] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 12e38a72-0ece-480e-ba69-6d43bb17ff6a not found, creating... [ 948.221983] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.222168] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.222285] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.222521] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.222703] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.222978] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.223872] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.224144] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.224426] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.225095] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.225095] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 12e38a72-0ece-480e-ba69-6d43bb17ff6a is going to be created. [ 948.243643] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.245031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.245031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.245031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.245031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.245031] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a088526-39aa-4b85-a4b7-780ad374c69e is going to be created. [ 948.252912] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.252912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.252912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.252912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.252912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.252912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.263155] env[65553]: INFO networking_nsxv3.common.synchronization [None req-61ae2b2d-4d20-4c7b-bbb3-c0673495cb43 None None] Enqueued Resource ID: db9f3aee-9f4e-4776-a894-768357795731 with Priority: HIGHEST for action port [ 948.264366] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9f3aee-9f4e-4776-a894-768357795731 with Priority: HIGHEST for action port [ 948.266805] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-db9f3aee-9f4e-4776-a894-768357795731 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.266805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db9f3aee-9f4e-4776-a894-768357795731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.266805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db9f3aee-9f4e-4776-a894-768357795731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.266805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db9f3aee-9f4e-4776-a894-768357795731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.266805] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db9f3aee-9f4e-4776-a894-768357795731',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.300842] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.301055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.301142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.301407] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.301571] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.324994] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a088526-39aa-4b85-a4b7-780ad374c69e in Status: UNINITIALIZED for 2s [ 948.538665] env[65553]: INFO networking_nsxv3.common.synchronization [req-e13bc0e0-94a8-4f87-8d82-f561be18f030 req-be9a68a1-c18e-4700-b31e-c212af6137b2 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 948.539675] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 948.540148] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.540329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.540386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.540765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.540765] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.540897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.540949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.541074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.541206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.541260] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.772033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db9f3aee-9f4e-4776-a894-768357795731 [ 948.772251] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.772389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.772458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.772671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.772998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.773186] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db9f3aee-9f4e-4776-a894-768357795731 already deleted. [ 948.773352] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db9f3aee-9f4e-4776-a894-768357795731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.043692] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.071040] env[65553]: INFO networking_nsxv3.common.synchronization [req-50a017e5-7cb2-4b29-88f5-112b5cf38813 req-80c610f9-f524-4fd0-816d-ca63019cd0a4 service nova] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_rules [ 949.072899] env[65553]: INFO networking_nsxv3.common.synchronization [req-50a017e5-7cb2-4b29-88f5-112b5cf38813 req-80c610f9-f524-4fd0-816d-ca63019cd0a4 service nova] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 949.073288] env[65553]: INFO networking_nsxv3.common.synchronization [req-50a017e5-7cb2-4b29-88f5-112b5cf38813 req-80c610f9-f524-4fd0-816d-ca63019cd0a4 service nova] Enqueued Resource ID: 12e38a72-0ece-480e-ba69-6d43bb17ff6a with Priority: HIGHEST for action port [ 949.074110] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_rules [ 949.074368] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 949.074612] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e38a72-0ece-480e-ba69-6d43bb17ff6a with Priority: HIGHEST for action port [ 949.075462] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.075656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.075774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.076228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.076378] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.077791] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.077987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.078156] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.078463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.078706] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.078891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.079052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.079300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.079450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.079604] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.081344] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e38a72-0ece-480e-ba69-6d43bb17ff6a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.082167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.082167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.082167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.082167] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e38a72-0ece-480e-ba69-6d43bb17ff6a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.220909] env[65553]: INFO networking_nsxv3.common.synchronization [None req-74e7cb98-33a2-43d6-afdd-d83bf3b6c353 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 949.221722] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 949.222137] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.222290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.549268] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.561863] env[65553]: INFO networking_nsxv3.common.synchronization [req-5e631285-80e7-4c77-a01c-84119b406478 req-7f52d9ec-cd8b-4c6f-9f18-d9ba2529b64d tempest-ImagesOneServerTestJSON-1339963175 tempest-ImagesOneServerTestJSON-1339963175-project-member] Enqueued Resource ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 with Priority: HIGHEST for action security_group_members [ 949.562424] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 with Priority: HIGHEST for action security_group_members [ 949.563355] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.563494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.563565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.563773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.564275] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.564275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.564275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.564275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.564461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.564461] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed7cc46a-1914-49e3-8b7d-d67e2682c5f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.589474] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.589601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.590535] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.591026] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12e38a72-0ece-480e-ba69-6d43bb17ff6a with status ACTIVE [ 949.591113] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.591543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.591543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.591543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.591662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.591848] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.591990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.592093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.592282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.592385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.592604] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.593023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.593023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.593023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.595109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.595109] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12e38a72-0ece-480e-ba69-6d43bb17ff6a is going to be updated. [ 949.622071] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.622262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.622262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.622473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.622604] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.622756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.781605] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f63d6b53-abb7-4440-b640-993d277a5dbd None None] Enqueued Resource ID: 367b4143-3267-455c-a884-decf080e0b57 with Priority: HIGHEST for action port [ 949.782495] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367b4143-3267-455c-a884-decf080e0b57 with Priority: HIGHEST for action port [ 949.783464] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-367b4143-3267-455c-a884-decf080e0b57 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.783757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-367b4143-3267-455c-a884-decf080e0b57" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.783861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-367b4143-3267-455c-a884-decf080e0b57" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.784249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-367b4143-3267-455c-a884-decf080e0b57" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.784380] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('367b4143-3267-455c-a884-decf080e0b57',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.989415] env[65553]: INFO networking_nsxv3.common.synchronization [req-034c4c3d-436e-46ef-ab71-5672d93ed748 req-68bca303-64d4-42a9-96ae-904a1ffadc36 tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 949.992153] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 949.992153] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.992153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.992153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.992153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.993497] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.993497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.993497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.995462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.995661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.996018] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.051527] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.053237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.053237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.053237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.053237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.053237] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 950.064900] env[65553]: INFO networking_nsxv3.common.synchronization [req-e7caa71b-e3b9-47ea-a6df-87bba2fa9481 req-929b90d4-5443-4b89-bb04-cd5ff072ad7b tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 950.065582] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 950.065938] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.066990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.067132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.069284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.069473] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.069676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.069804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.071180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.075140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.075140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.075140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.075140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.075140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.075140] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.097197] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.101718] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.101866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.101938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.103151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.103151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.108742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.109044] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.109169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.109235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.109482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.109577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.109671] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 is going to be updated. [ 950.114950] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 950.143045] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.143244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.143354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.143594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.143767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.155699] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 in Status: IN_PROGRESS for 2s [ 950.288050] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 367b4143-3267-455c-a884-decf080e0b57 [ 950.288050] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.288050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.288050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.288050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.288050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.288050] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:367b4143-3267-455c-a884-decf080e0b57 already deleted. [ 950.288050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-367b4143-3267-455c-a884-decf080e0b57" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.343075] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a088526-39aa-4b85-a4b7-780ad374c69e in Status: SUCCESS [ 950.343371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.343560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.343814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.344046] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.344199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.344269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.344431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.344808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.346010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.346465] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.502884] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.503063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.503193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.503437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.503511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.503685] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.503808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.503862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.504035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.504106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.504759] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 950.544196] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.547049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.547049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.547049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.547049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.560176] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 950.583033] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.583033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.583033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.584863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.584863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.584863] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.584863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.584863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.584863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.584863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.584863] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd already deleted. [ 950.584863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.604714] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.604714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.604714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.604955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.604955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.605070] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 is going to be created. [ 950.641775] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.641973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.642065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.642300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.642780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.655054] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: UNINITIALIZED for 2s [ 950.759539] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.759769] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.759852] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.761411] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.761782] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.761958] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.763490] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.763772] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.763927] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.764160] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.764274] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.764381] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.764487] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.764599] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.764760] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.764971] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.783149] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.783373] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 950.783544] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.783723] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.784294] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-7084ea98-5883-4656-868f-82acd88903ba taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.786038] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-7084ea98-5883-4656-868f-82acd88903ba" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.786177] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-7084ea98-5883-4656-868f-82acd88903ba" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.786500] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-7084ea98-5883-4656-868f-82acd88903ba" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.786641] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7084ea98-5883-4656-868f-82acd88903ba',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.851042] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.290741] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.291151] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.291274] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.292562] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.292562] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.292562] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 7084ea98-5883-4656-868f-82acd88903ba not found, creating... [ 951.292761] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.292914] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.293151] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.293469] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.293625] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.293995] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.295276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.295276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.295276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.295276] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.295276] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 7084ea98-5883-4656-868f-82acd88903ba is going to be created. [ 951.310686] env[65553]: INFO networking_nsxv3.common.synchronization [None req-c192cb4b-135b-4966-9035-541b89970b72 None None] Enqueued Resource ID: faf8dd40-01ce-4252-89f8-41490258ab97 with Priority: HIGHEST for action port [ 951.311540] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faf8dd40-01ce-4252-89f8-41490258ab97 with Priority: HIGHEST for action port [ 951.313319] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-faf8dd40-01ce-4252-89f8-41490258ab97 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.313461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faf8dd40-01ce-4252-89f8-41490258ab97" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.313531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faf8dd40-01ce-4252-89f8-41490258ab97" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.313812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faf8dd40-01ce-4252-89f8-41490258ab97" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.314353] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faf8dd40-01ce-4252-89f8-41490258ab97',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.331772] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.332020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.332149] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.332427] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.332656] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.332895] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-7084ea98-5883-4656-868f-82acd88903ba" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.353678] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a088526-39aa-4b85-a4b7-780ad374c69e: rpc.has_security_group_logging(os_id): False [ 951.379655] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.379813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.380357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.380357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.380357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.380520] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.380600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.380682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.384025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.384025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.384025] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a088526-39aa-4b85-a4b7-780ad374c69e is going to be created. [ 951.474836] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.475026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.475087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.475296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.475486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.501551] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a088526-39aa-4b85-a4b7-780ad374c69e in Status: IN_PROGRESS for 2s [ 951.820403] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faf8dd40-01ce-4252-89f8-41490258ab97 [ 951.820403] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.820403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.820403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.820403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.820403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.820403] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faf8dd40-01ce-4252-89f8-41490258ab97 already deleted. [ 951.820403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faf8dd40-01ce-4252-89f8-41490258ab97" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.067019] env[65553]: INFO networking_nsxv3.common.synchronization [req-e7caa71b-e3b9-47ea-a6df-87bba2fa9481 req-5db973ed-0f08-4662-a1d1-4a653d4bdddf service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 952.067019] env[65553]: INFO networking_nsxv3.common.synchronization [req-e7caa71b-e3b9-47ea-a6df-87bba2fa9481 req-5db973ed-0f08-4662-a1d1-4a653d4bdddf service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 952.067019] env[65553]: INFO networking_nsxv3.common.synchronization [req-e7caa71b-e3b9-47ea-a6df-87bba2fa9481 req-5db973ed-0f08-4662-a1d1-4a653d4bdddf service nova] Enqueued Resource ID: 7084ea98-5883-4656-868f-82acd88903ba with Priority: HIGHEST for action port [ 952.067019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 952.067019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 952.067019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7084ea98-5883-4656-868f-82acd88903ba with Priority: HIGHEST for action port [ 952.067019] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.067019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.067019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.067659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.067828] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.069156] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.069445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.069731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.070417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.072018] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.072018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.072018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.072018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.072018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.072018] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.072018] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-7084ea98-5883-4656-868f-82acd88903ba taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.073712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7084ea98-5883-4656-868f-82acd88903ba" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.073889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7084ea98-5883-4656-868f-82acd88903ba" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.074133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7084ea98-5883-4656-868f-82acd88903ba" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.074292] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7084ea98-5883-4656-868f-82acd88903ba',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.129077] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 952.129077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.129077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.129077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.129077] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.129077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.129077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.129077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.129077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.129077] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.168024] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 in Status: SUCCESS [ 952.168024] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 deletion is rescheduled due to dependency. [ 952.168024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.329199] env[65553]: INFO networking_nsxv3.common.synchronization [req-df3f77fb-9b17-433a-bac2-76e86c3348cf req-a3a1786c-3ff9-4802-b026-108e9d649969 tempest-ImagesOneServerNegativeTestJSON-967710394 tempest-ImagesOneServerNegativeTestJSON-967710394-project-member] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 952.329199] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGHEST for action security_group_members [ 952.329199] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.329693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.330081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.330081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.330177] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.330229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.330265] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.330421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.331224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.331224] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.576710] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 952.577315] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 deletion is rescheduled due to dependency. [ 952.577315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.577447] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.577549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.577676] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.582963] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7084ea98-5883-4656-868f-82acd88903ba with status ACTIVE [ 952.582963] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.582963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.583162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.583569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.583569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.583683] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.583746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.583801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.583943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.584031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.584485] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.584485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.584485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.584670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.584670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.584780] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7084ea98-5883-4656-868f-82acd88903ba is going to be updated. [ 952.608038] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.608346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.608346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.608582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.608721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.608884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7084ea98-5883-4656-868f-82acd88903ba" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.633034] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.633034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.633034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.633367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.633367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.633563] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.633687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.634641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.634641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.634641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.634641] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 952.673261] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: SUCCESS [ 952.673261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.673261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.673933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.674217] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.675395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.675542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.675804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.677186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.677186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.677186] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.678640] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.678759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.678822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.679332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.680252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.689137] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 952.807884] env[65553]: INFO networking_nsxv3.common.synchronization [req-3f38fcf5-205f-402a-8794-ac1d6a1ff0dc req-f0a84950-1bb5-4c1e-983c-b1c6c11d5fe6 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_members [ 952.807884] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGHEST for action security_group_members [ 952.808204] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d71eb658-afb5-408d-a69d-dac4485c2f2e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.808487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.808668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.810779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.810779] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.810779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.810779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.810779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.810779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.810779] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.834116] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.834116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.834116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.838022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.838022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.838022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.838022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.838022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.838022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.838022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.838022] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be updated. [ 952.880426] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.883980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.883980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.883980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.883980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.893197] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: IN_PROGRESS for 2s [ 953.086996] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.181900] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.312692] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.312853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.312916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.313185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.313279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.313491] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.313595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.313656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.313812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.313890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.313974] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71eb658-afb5-408d-a69d-dac4485c2f2e is going to be updated. [ 953.355076] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.355076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.355076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.355076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.355076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.365939] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71eb658-afb5-408d-a69d-dac4485c2f2e in Status: IN_PROGRESS for 2s [ 953.519087] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a088526-39aa-4b85-a4b7-780ad374c69e in Status: SUCCESS [ 953.519087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.595800] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.597142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.597363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.598027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.598027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.598197] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be created. [ 953.635041] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.635041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.635041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.635041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.635041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.655374] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: UNINITIALIZED for 2s [ 953.686229] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 078f6ece-0f89-4be3-969f-f776c18c6fc6: rpc.has_security_group_logging(os_id): False [ 953.705066] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.707196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.707196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.707196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.707196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.707196] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.707196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.707196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.707196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.707196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.707196] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 is going to be created. [ 953.780019] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.780185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.780250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.781203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.781203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.785301] env[65553]: INFO networking_nsxv3.common.synchronization [None req-52430f9a-48e4-4ffa-a3fc-beb27a4eeaf4 None None] Enqueued Resource ID: 11126668-46fa-4919-99b2-e3b4ee7757a4 with Priority: HIGHEST for action port [ 953.786120] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11126668-46fa-4919-99b2-e3b4ee7757a4 with Priority: HIGHEST for action port [ 953.786476] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-11126668-46fa-4919-99b2-e3b4ee7757a4 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.786675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11126668-46fa-4919-99b2-e3b4ee7757a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.786918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11126668-46fa-4919-99b2-e3b4ee7757a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.787190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11126668-46fa-4919-99b2-e3b4ee7757a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.787312] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11126668-46fa-4919-99b2-e3b4ee7757a4',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.796963] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: IN_PROGRESS for 2s [ 954.236465] env[65553]: INFO networking_nsxv3.common.synchronization [req-635f1c0d-a536-49fe-889a-ca4fce4d2f2a req-d9609cb1-19c2-45f2-a423-472f5be771f6 tempest-ServerActionsV293TestJSON-138104853 tempest-ServerActionsV293TestJSON-138104853-project-member] Enqueued Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_members [ 954.242092] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762d4374-c484-417a-aad8-0a36a186516f with Priority: HIGHEST for action security_group_members [ 954.242946] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-762d4374-c484-417a-aad8-0a36a186516f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.243112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.244644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.244644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.244644] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.244644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.244644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.244644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.244644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.244644] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('762d4374-c484-417a-aad8-0a36a186516f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.289986] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11126668-46fa-4919-99b2-e3b4ee7757a4 [ 954.290234] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.290387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.290470] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.290702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.290796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.290876] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11126668-46fa-4919-99b2-e3b4ee7757a4 already deleted. [ 954.291031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11126668-46fa-4919-99b2-e3b4ee7757a4" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.701549] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 954.701892] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 deletion is rescheduled due to dependency. [ 954.701892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.751416] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.751561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.751657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.751854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.781679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.781679] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.781679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.781679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.781840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.781915] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.782014] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d4374-c484-417a-aad8-0a36a186516f is going to be updated. [ 954.824238] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.824680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.824953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.825284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.825538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.836793] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d4374-c484-417a-aad8-0a36a186516f in Status: IN_PROGRESS for 2s [ 954.902626] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 in Status: SUCCESS [ 954.902805] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 deletion is rescheduled due to dependency. [ 954.902913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.287861] env[65553]: INFO networking_nsxv3.common.synchronization [req-8fe6c9dc-0fd6-45f9-8077-3cd331f992bf req-6558e9fe-9856-4277-8208-a0a504ab77db tempest-AttachVolumeTestJSON-579631701 tempest-AttachVolumeTestJSON-579631701-project-member] Enqueued Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_members [ 955.288993] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_members [ 955.289633] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb67cc18-9ceb-429a-844d-a60317217b7b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.289775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.289959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.290512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.290671] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.290777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.290847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.290990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.291075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.291280] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.380402] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d71eb658-afb5-408d-a69d-dac4485c2f2e in Status: SUCCESS [ 955.380595] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d71eb658-afb5-408d-a69d-dac4485c2f2e deletion is rescheduled due to dependency. [ 955.380715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.388828] env[65553]: INFO networking_nsxv3.common.synchronization [req-604b91d2-e8a3-4907-be5a-1189a6afc21a req-36dc5930-00f6-4117-9451-6a6fbe656ab8 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_members [ 955.389484] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGHEST for action security_group_members [ 955.389824] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-424e0166-59a6-441d-abf8-1fa9f2584819 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.389959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.390044] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.390256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.390408] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.390743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.390743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.390743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.390908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.390908] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.669572] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 955.669572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.669572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.669862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.669862] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.669975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.670029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.670176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.670230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.670313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.670441] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.795237] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.795666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.795666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.795883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.795960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.796642] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.796642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.796642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.796642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.796642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.796642] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb67cc18-9ceb-429a-844d-a60317217b7b already deleted. [ 955.796956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.819274] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: SUCCESS [ 955.819274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.893985] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.896290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.896290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.896290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.922161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.922161] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.922161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.922161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.922161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.922161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.922161] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 424e0166-59a6-441d-abf8-1fa9f2584819 is going to be updated. [ 955.955241] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.955459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.955536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.955748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.955891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.967088] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 424e0166-59a6-441d-abf8-1fa9f2584819 in Status: IN_PROGRESS for 2s [ 956.063240] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.063240] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-895" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.063240] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-895" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.063867] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-895" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.063867] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.064092] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.064352] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.064583] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.064776] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.066189] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.066189] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.066189] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.066189] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.066189] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.066189] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.066189] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.088994] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.089226] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 956.089377] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.089608] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-895" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.089946] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-56f21303-8afa-4695-b8c1-eb3765a42bc8 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.090133] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-56f21303-8afa-4695-b8c1-eb3765a42bc8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.090252] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-56f21303-8afa-4695-b8c1-eb3765a42bc8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.090615] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-56f21303-8afa-4695-b8c1-eb3765a42bc8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.090734] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56f21303-8afa-4695-b8c1-eb3765a42bc8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.177276] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.177276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.177276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.177276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.177276] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.177276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.177276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.177276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.177693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.177839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.178100] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.178402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.178499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.178681] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.178862] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.179061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.179373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.179532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.179532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.179678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.179759] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.594921] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.594921] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.594921] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.594921] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.594921] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.594921] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 56f21303-8afa-4695-b8c1-eb3765a42bc8 not found, creating... [ 956.594921] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.594921] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.594921] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.595403] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.595403] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.596052] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.596052] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.596206] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.596428] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.596626] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.596907] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 56f21303-8afa-4695-b8c1-eb3765a42bc8 is going to be created. [ 956.638325] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.638544] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.638767] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.638955] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.639233] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.639465] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-56f21303-8afa-4695-b8c1-eb3765a42bc8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.687424] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9009da09-3880-4f06-b8cc-6f3ff62a7fbd: rpc.has_security_group_logging(os_id): False [ 956.718565] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.718736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.718736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.719338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.719338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.719338] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.719465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.719505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.719678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.719788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.720030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.720136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.720224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.720385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.720478] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.721245] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.721245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.721245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.721245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.721444] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.721444] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be created. [ 956.835724] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.836051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.836051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.836175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.836359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.872483] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 762d4374-c484-417a-aad8-0a36a186516f in Status: SUCCESS [ 956.872625] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 762d4374-c484-417a-aad8-0a36a186516f deletion is rescheduled due to dependency. [ 956.872689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-762d4374-c484-417a-aad8-0a36a186516f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.875349] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 956.959549] env[65553]: INFO networking_nsxv3.common.synchronization [req-cf888ebe-96cd-4643-b3c5-824a01e49031 req-1f06a05c-1864-4595-8603-b98047cf5f50 tempest-ImagesTestJSON-1118693169 tempest-ImagesTestJSON-1118693169-project-member] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 956.961252] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGHEST for action security_group_members [ 956.962135] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.962135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.962135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.962135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.962534] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.962534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.962534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.962534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.962664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.962724] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.235573] env[65553]: INFO networking_nsxv3.common.synchronization [req-c20a04db-f328-4aa1-af67-b09ec4c81997 req-7efb14f3-f7fb-418b-a854-abbd05a5beaa tempest-ServersAdminTestJSON-844759989 tempest-ServersAdminTestJSON-844759989-project-member] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 957.236322] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 957.236713] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.237822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.237932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.238160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.238317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.238494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.238494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.238617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.238701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.238793] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.370794] env[65553]: INFO networking_nsxv3.common.synchronization [req-8fe6c9dc-0fd6-45f9-8077-3cd331f992bf req-764166c7-d3bc-4c14-90a7-7438aaa12b64 service nova] Enqueued Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_rules [ 957.371223] env[65553]: INFO networking_nsxv3.common.synchronization [req-8fe6c9dc-0fd6-45f9-8077-3cd331f992bf req-764166c7-d3bc-4c14-90a7-7438aaa12b64 service nova] Enqueued Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_members [ 957.371440] env[65553]: INFO networking_nsxv3.common.synchronization [req-8fe6c9dc-0fd6-45f9-8077-3cd331f992bf req-764166c7-d3bc-4c14-90a7-7438aaa12b64 service nova] Enqueued Resource ID: 56f21303-8afa-4695-b8c1-eb3765a42bc8 with Priority: HIGHEST for action port [ 957.373977] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_rules [ 957.374220] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_members [ 957.374390] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56f21303-8afa-4695-b8c1-eb3765a42bc8 with Priority: HIGHEST for action port [ 957.375272] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb67cc18-9ceb-429a-844d-a60317217b7b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.375483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.375589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.375842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.376036] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.380744] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb67cc18-9ceb-429a-844d-a60317217b7b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.380989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.381080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.381287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.381467] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.381568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.381632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.381777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.381864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.382016] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.382968] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-56f21303-8afa-4695-b8c1-eb3765a42bc8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.383157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56f21303-8afa-4695-b8c1-eb3765a42bc8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.383295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56f21303-8afa-4695-b8c1-eb3765a42bc8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.383431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56f21303-8afa-4695-b8c1-eb3765a42bc8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.383527] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56f21303-8afa-4695-b8c1-eb3765a42bc8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.466726] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.466917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.467013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.467249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.467342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.467545] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.467637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.467712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.467864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.467943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.468045] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be updated. [ 957.503563] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.503708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.503776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.503985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.504136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.515551] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: IN_PROGRESS for 2s [ 957.742136] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.885878] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb67cc18-9ceb-429a-844d-a60317217b7b taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.886220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.886484] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.888496] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56f21303-8afa-4695-b8c1-eb3765a42bc8 with status ACTIVE [ 957.889312] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.890684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.890730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.890968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.891072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.891466] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.891577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.891639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.891798] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.891886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.892111] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.892204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.892270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.892422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.892493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.892572] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56f21303-8afa-4695-b8c1-eb3765a42bc8 is going to be updated. [ 957.927390] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.927627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.927669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.928092] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.928236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.928999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56f21303-8afa-4695-b8c1-eb3765a42bc8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.982461] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 424e0166-59a6-441d-abf8-1fa9f2584819 in Status: SUCCESS [ 957.982644] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 424e0166-59a6-441d-abf8-1fa9f2584819 deletion is rescheduled due to dependency. [ 957.982926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.247935] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.390312] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.757059] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.757059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.757059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.758692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.759335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.761206] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 958.806189] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.806189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.806189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.806189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.806189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.818691] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 958.895027] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.895027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.895027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.895027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.895027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.895027] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb67cc18-9ceb-429a-844d-a60317217b7b is going to be created. [ 958.897269] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 958.897864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.927469] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.927682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.927776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.927959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.928212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.940948] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb67cc18-9ceb-429a-844d-a60317217b7b in Status: UNINITIALIZED for 2s [ 959.530422] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 in Status: SUCCESS [ 959.530603] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 deletion is rescheduled due to dependency. [ 959.530714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.833388] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 960.833721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.956017] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb67cc18-9ceb-429a-844d-a60317217b7b in Status: SUCCESS [ 960.956306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.956506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.956757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.958386] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.958525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.958595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.958797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.958857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.958941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.959044] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.463228] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.966680] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb67cc18-9ceb-429a-844d-a60317217b7b: rpc.has_security_group_logging(os_id): False [ 961.992701] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.992912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.993020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.993329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.993453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.993786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.993927] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.994029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.994264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.994375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.994495] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb67cc18-9ceb-429a-844d-a60317217b7b is going to be created. [ 962.072358] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.072358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.072358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.072672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.072782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.087776] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb67cc18-9ceb-429a-844d-a60317217b7b in Status: IN_PROGRESS for 2s [ 962.375384] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 962.375534] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 962.897809] env[65553]: INFO networking_nsxv3.common.synchronization [req-0225c504-f874-42bc-930d-b275f4c03ba2 req-62eacff5-2880-46a7-9636-dfa5a3e84243 tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 962.898459] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 962.898809] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.898932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.899032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.899289] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.899454] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.899567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.899640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.899809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.899896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.900016] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.403721] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.403721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.403721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.403721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.404130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.404130] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.404340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.404489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.404653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.404740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.404856] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 963.439110] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.439110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.439271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.439400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.441864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.458700] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 964.106170] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb67cc18-9ceb-429a-844d-a60317217b7b in Status: SUCCESS [ 964.106170] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.404840] env[65553]: INFO networking_nsxv3.common.synchronization [req-37828b4a-a000-4e09-b0c9-d9a089924b4b req-6d3662f3-c1c3-48c7-90d0-d603ea97c27a tempest-ServersNegativeTestJSON-1019655983 tempest-ServersNegativeTestJSON-1019655983-project-member] Enqueued Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 964.405862] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 964.405862] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.406011] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.406011] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.407260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.407260] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.407260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.407260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.407260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.407260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.407260] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.909391] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.909618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.909618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.910115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.910115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.910115] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.910606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.910606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.910606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.910606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.910606] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f already deleted. [ 964.910744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.952471] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-799 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.953113] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.953226] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.954297] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.954750] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.955053] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.955196] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.955489] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.955685] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.955859] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.956159] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.956159] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.956290] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.956416] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.956521] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.956667] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.978133] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.978330] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 964.978471] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.978713] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.979182] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-5271e9dd-24bd-4c91-a30d-2085e7809b02 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.979339] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.979520] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.979862] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.980014] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5271e9dd-24bd-4c91-a30d-2085e7809b02',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.347906] env[65553]: INFO networking_nsxv3.common.synchronization [None req-a9bf69a6-d127-4925-8d2c-e15fb289b91d None None] Enqueued Resource ID: 2aa77633-8f41-41f7-a63e-d40f32d814ef with Priority: HIGHEST for action port [ 965.348535] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa77633-8f41-41f7-a63e-d40f32d814ef with Priority: HIGHEST for action port [ 965.348852] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2aa77633-8f41-41f7-a63e-d40f32d814ef taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.349041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2aa77633-8f41-41f7-a63e-d40f32d814ef" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.349134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2aa77633-8f41-41f7-a63e-d40f32d814ef" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.349408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2aa77633-8f41-41f7-a63e-d40f32d814ef" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.349541] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aa77633-8f41-41f7-a63e-d40f32d814ef',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.474467] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 965.474467] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 965.474467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.483658] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.484069] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.484258] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.484660] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.484908] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.485156] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 5271e9dd-24bd-4c91-a30d-2085e7809b02 not found, creating... [ 965.485534] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.485736] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.485837] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.486214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.486458] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.487828] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.488174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.488361] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.488631] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.488808] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.488985] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 5271e9dd-24bd-4c91-a30d-2085e7809b02 is going to be created. [ 965.511480] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.511688] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.511902] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.512381] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.512381] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.512530] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.853547] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2aa77633-8f41-41f7-a63e-d40f32d814ef [ 965.853933] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.854178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.854448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.854976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.855168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.855311] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2aa77633-8f41-41f7-a63e-d40f32d814ef already deleted. [ 965.855452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2aa77633-8f41-41f7-a63e-d40f32d814ef" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.354177] env[65553]: INFO networking_nsxv3.common.synchronization [req-37828b4a-a000-4e09-b0c9-d9a089924b4b req-e4454b87-75f8-423b-b6c4-fea0f56b7a66 service nova] Enqueued Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_rules [ 966.355907] env[65553]: INFO networking_nsxv3.common.synchronization [req-37828b4a-a000-4e09-b0c9-d9a089924b4b req-e4454b87-75f8-423b-b6c4-fea0f56b7a66 service nova] Enqueued Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 966.355907] env[65553]: INFO networking_nsxv3.common.synchronization [req-37828b4a-a000-4e09-b0c9-d9a089924b4b req-e4454b87-75f8-423b-b6c4-fea0f56b7a66 service nova] Enqueued Resource ID: 5271e9dd-24bd-4c91-a30d-2085e7809b02 with Priority: HIGHEST for action port [ 966.355907] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_rules [ 966.355907] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 966.355907] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5271e9dd-24bd-4c91-a30d-2085e7809b02 with Priority: HIGHEST for action port [ 966.355907] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.355907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.355907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.356549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.356549] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.357669] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.357669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.357669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.357669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.357669] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.357956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.357956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.357956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.358363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.358363] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.359869] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-5271e9dd-24bd-4c91-a30d-2085e7809b02 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.359869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.359869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.359869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.359869] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5271e9dd-24bd-4c91-a30d-2085e7809b02',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.625543] env[65553]: INFO networking_nsxv3.common.synchronization [req-bce64cb1-a2a6-4c31-8c2e-dd8ed390303b req-90fff826-3d5b-4ddf-a022-c7ba3ff4a1e1 tempest-ServerRescueTestJSON-981888117 tempest-ServerRescueTestJSON-981888117-project-member] Enqueued Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 966.626718] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 966.627211] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.627653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.627653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.627826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.627892] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.628417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.628417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.628933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.629096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.629210] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.861645] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.862811] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.863690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.863690] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5271e9dd-24bd-4c91-a30d-2085e7809b02 with status ACTIVE [ 966.863690] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.863690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.863690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.863946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.863946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.864140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.864233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.864291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.864471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.864568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.868090] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.868090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.868090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.868090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.868090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.868090] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5271e9dd-24bd-4c91-a30d-2085e7809b02 is going to be updated. [ 966.891806] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.892196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.892196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.892510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.892677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.892840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.073032] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.073265] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-506" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.073420] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-506" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.073768] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-506" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.074198] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.074479] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.074640] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.074938] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.076041] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.076041] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.076041] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.076041] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.076041] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.076041] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.076284] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.076284] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.106053] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.106053] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 967.106234] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.106363] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-506" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.106719] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-75dfc699-262a-4e9f-8840-16dd389f3f51 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.106986] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-75dfc699-262a-4e9f-8840-16dd389f3f51" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.107155] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-75dfc699-262a-4e9f-8840-16dd389f3f51" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.107493] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-75dfc699-262a-4e9f-8840-16dd389f3f51" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.107627] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75dfc699-262a-4e9f-8840-16dd389f3f51',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.131767] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.368576] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.610447] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.610705] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.610868] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.611280] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.611506] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.611716] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 75dfc699-262a-4e9f-8840-16dd389f3f51 not found, creating... [ 967.612103] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.612329] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.612490] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.612793] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.612988] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.613439] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.613762] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.613928] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.614164] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.614297] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.614438] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 75dfc699-262a-4e9f-8840-16dd389f3f51 is going to be created. [ 967.634235] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.638107] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.638330] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.638451] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.638766] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.638956] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.639205] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-75dfc699-262a-4e9f-8840-16dd389f3f51" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.795740] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d5dbffea-e497-44bf-9fa7-e1d45a5df528 None None] Enqueued Resource ID: b05ac67f-ca0f-486b-9c65-d09c6b6a1f1b with Priority: HIGHEST for action port [ 967.796825] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b05ac67f-ca0f-486b-9c65-d09c6b6a1f1b with Priority: HIGHEST for action port [ 967.797464] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-b05ac67f-ca0f-486b-9c65-d09c6b6a1f1b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.797694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b05ac67f-ca0f-486b-9c65-d09c6b6a1f1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.797807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b05ac67f-ca0f-486b-9c65-d09c6b6a1f1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.798190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b05ac67f-ca0f-486b-9c65-d09c6b6a1f1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.798348] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b05ac67f-ca0f-486b-9c65-d09c6b6a1f1b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.870161] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.870372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.870453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.870673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.870768] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.870922] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f is going to be created. [ 967.902850] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.903293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.903422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.903675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.903842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.919360] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: UNINITIALIZED for 2s [ 968.138069] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.138069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.138069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.138069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.138069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.138069] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b is going to be updated. [ 968.177662] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.177818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.177929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.178136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.178312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.193671] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: IN_PROGRESS for 2s [ 968.301348] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b05ac67f-ca0f-486b-9c65-d09c6b6a1f1b [ 968.301661] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.301863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.301951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.302237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.302357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.302462] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b05ac67f-ca0f-486b-9c65-d09c6b6a1f1b already deleted. [ 968.302572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b05ac67f-ca0f-486b-9c65-d09c6b6a1f1b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.375027] env[65553]: INFO networking_nsxv3.common.synchronization [req-bce64cb1-a2a6-4c31-8c2e-dd8ed390303b req-ba4c0374-1ca1-4314-b10e-5f31ed66a373 service nova] Enqueued Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_rules [ 968.375027] env[65553]: INFO networking_nsxv3.common.synchronization [req-bce64cb1-a2a6-4c31-8c2e-dd8ed390303b req-ba4c0374-1ca1-4314-b10e-5f31ed66a373 service nova] Enqueued Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 968.375027] env[65553]: INFO networking_nsxv3.common.synchronization [req-bce64cb1-a2a6-4c31-8c2e-dd8ed390303b req-ba4c0374-1ca1-4314-b10e-5f31ed66a373 service nova] Enqueued Resource ID: 75dfc699-262a-4e9f-8840-16dd389f3f51 with Priority: HIGHEST for action port [ 968.375480] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_rules [ 968.375818] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 968.376033] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75dfc699-262a-4e9f-8840-16dd389f3f51 with Priority: HIGHEST for action port [ 968.376571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.376867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.377116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.377990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.377990] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.378869] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.379639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.384020] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-75dfc699-262a-4e9f-8840-16dd389f3f51 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.384020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75dfc699-262a-4e9f-8840-16dd389f3f51" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.384020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75dfc699-262a-4e9f-8840-16dd389f3f51" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.384020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75dfc699-262a-4e9f-8840-16dd389f3f51" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.384020] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75dfc699-262a-4e9f-8840-16dd389f3f51',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.885055] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.885055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.885055] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75dfc699-262a-4e9f-8840-16dd389f3f51 with status ACTIVE [ 968.885055] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.885636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.885636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.885636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.885636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.885771] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.885818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.885859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.886015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.886098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.886286] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.886391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.886429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.886560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.886635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.886718] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75dfc699-262a-4e9f-8840-16dd389f3f51 is going to be updated. [ 968.917420] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.917569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.917693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.917858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.918043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.918223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75dfc699-262a-4e9f-8840-16dd389f3f51" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.143488] env[65553]: INFO networking_nsxv3.common.synchronization [req-1c0104ad-1559-4ff0-bea1-424bbc0e6dc5 req-97a7dd4c-2d29-4bca-9e73-273d2c54c521 tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 969.146052] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 969.146052] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.146052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.146052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.146052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.146052] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.146052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.146052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.146052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.146052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.146590] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.652184] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.652425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.652496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.652713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.652801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.655332] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.655332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.655332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.655332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.655332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.655332] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 969.672687] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.672910] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.673020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.673285] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.673531] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.673682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.673795] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.674020] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.674554] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.674817] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.674923] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.675084] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.675211] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.675325] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.675430] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.675558] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.680767] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.680907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.680992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.682830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.682984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.694270] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 969.697649] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.697818] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 969.697957] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.698201] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.698518] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-20ef9495-ca72-487e-9f30-6b88868d84ac taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.698689] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-20ef9495-ca72-487e-9f30-6b88868d84ac" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.698807] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-20ef9495-ca72-487e-9f30-6b88868d84ac" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.699158] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-20ef9495-ca72-487e-9f30-6b88868d84ac" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.699321] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20ef9495-ca72-487e-9f30-6b88868d84ac',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.934741] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: SUCCESS [ 969.935132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.935312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.935643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.935947] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.937429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.937429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.937429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.937429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.937429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.937429] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.205767] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.206048] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.206282] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.206541] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.206796] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.206948] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 20ef9495-ca72-487e-9f30-6b88868d84ac not found, creating... [ 970.207283] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.207477] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.207596] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.207862] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.208059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.208403] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.208598] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.208729] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.208974] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.209156] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.209330] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 20ef9495-ca72-487e-9f30-6b88868d84ac is going to be created. [ 970.211435] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: SUCCESS [ 970.211647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.212469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.212646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.212932] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.213019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.213086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.213302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.213302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.213425] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.216414] env[65553]: INFO networking_nsxv3.common.synchronization [req-8dde8589-6237-4246-a7d3-d1ff4e44fc11 req-9051a100-b0c0-485c-bdf4-dda08f3ac967 tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_members [ 970.217161] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76312788-a044-46c4-912d-a43bc9c8e59f with Priority: HIGHEST for action security_group_members [ 970.217499] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-76312788-a044-46c4-912d-a43bc9c8e59f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.217680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.217680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.217882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.218043] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.218155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.218229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.218387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.218469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.220168] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76312788-a044-46c4-912d-a43bc9c8e59f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.235890] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.236082] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.236214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.236482] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.236711] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.237014] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-20ef9495-ca72-487e-9f30-6b88868d84ac" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.446239] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.446239] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.446239] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.446239] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.446239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.447130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.447130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.447130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.447130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.447130] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.718591] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.721978] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.722212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.722309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.722624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.745556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.745840] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.745964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.746054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.746263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.746345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.746440] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76312788-a044-46c4-912d-a43bc9c8e59f is going to be updated. [ 970.779268] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.779426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.779470] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.779646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.779787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.790836] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76312788-a044-46c4-912d-a43bc9c8e59f in Status: IN_PROGRESS for 2s [ 970.949958] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d5d7b40-1056-43d4-a9d4-099288f67f0f: rpc.has_security_group_logging(os_id): False [ 970.971454] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.971664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.971664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.971958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.971958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.972430] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.972430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.972430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.972591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.972591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.973043] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.973043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.973043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.973197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.973197] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.973378] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.973462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.973546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.973644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.973714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.973797] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f is going to be created. [ 970.981459] env[65553]: INFO networking_nsxv3.common.synchronization [req-1c0104ad-1559-4ff0-bea1-424bbc0e6dc5 req-92380980-045d-4ffa-886a-5ca39b6850ac service nova] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_rules [ 970.981633] env[65553]: INFO networking_nsxv3.common.synchronization [req-1c0104ad-1559-4ff0-bea1-424bbc0e6dc5 req-92380980-045d-4ffa-886a-5ca39b6850ac service nova] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 970.981770] env[65553]: INFO networking_nsxv3.common.synchronization [req-1c0104ad-1559-4ff0-bea1-424bbc0e6dc5 req-92380980-045d-4ffa-886a-5ca39b6850ac service nova] Enqueued Resource ID: 20ef9495-ca72-487e-9f30-6b88868d84ac with Priority: HIGHEST for action port [ 970.982299] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_rules [ 970.982500] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 970.982630] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ef9495-ca72-487e-9f30-6b88868d84ac with Priority: HIGHEST for action port [ 970.982910] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.983956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.984104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.984245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.984331] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.985234] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.985348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.985553] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-20ef9495-ca72-487e-9f30-6b88868d84ac taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.985703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20ef9495-ca72-487e-9f30-6b88868d84ac" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.985769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20ef9495-ca72-487e-9f30-6b88868d84ac" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.985938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20ef9495-ca72-487e-9f30-6b88868d84ac" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.986038] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20ef9495-ca72-487e-9f30-6b88868d84ac',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.093421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.093421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.093421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.095948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.095948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.110341] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: IN_PROGRESS for 2s [ 971.222581] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.490319] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.490566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.490791] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20ef9495-ca72-487e-9f30-6b88868d84ac with status ACTIVE [ 971.491151] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.491151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.491291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.491598] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.491702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.491913] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.492393] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.492393] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.492998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.492998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.492998] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.493539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.493539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.493539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.493539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.494231] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20ef9495-ca72-487e-9f30-6b88868d84ac is going to be updated. [ 971.520709] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.520901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.520947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.521171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.521317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.521520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20ef9495-ca72-487e-9f30-6b88868d84ac" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.711395] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 971.711617] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 deletion is rescheduled due to dependency. [ 971.712079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.712079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.712228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.712476] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.712639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.712715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.712911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.713060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.713171] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.727545] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.727782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.727782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.728082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.728199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.728275] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b is going to be updated. [ 971.772425] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.772693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.772693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.772894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.773056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.785140] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: IN_PROGRESS for 2s [ 972.215460] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.719696] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.802477] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76312788-a044-46c4-912d-a43bc9c8e59f in Status: SUCCESS [ 972.802598] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76312788-a044-46c4-912d-a43bc9c8e59f deletion is rescheduled due to dependency. [ 972.802640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76312788-a044-46c4-912d-a43bc9c8e59f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.124468] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: SUCCESS [ 973.124692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.222093] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.224811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.224811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.224811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.224811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.224811] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 973.258671] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.258671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.258671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.258865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.258865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.271053] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 973.804033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: SUCCESS [ 973.804779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.804779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.804779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.805036] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.805193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.805270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.805493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.805639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.805732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.805860] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.308040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.308419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.308419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.308526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.308705] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.308806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.308869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.309035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.309149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.309255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.309376] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.309493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.309550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.310109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.310109] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.310109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.310109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.310109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.310288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.310288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.310288] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.813203] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c60427c8-0bdd-4ef0-a14a-b6e54b6e072b: rpc.has_security_group_logging(os_id): False [ 974.835609] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.835609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.835609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.835609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.835609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.836345] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.836707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.836968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.837319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.837553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.841171] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.841171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.841171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.841171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.841171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.841171] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.841171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.841171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.841171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.841171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.841171] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b is going to be updated. [ 974.939674] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.939674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.939674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.939674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.939674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.964537] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: IN_PROGRESS for 2s [ 975.285529] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 975.285529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.285529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.285529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.285529] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.285529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.285797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.285797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.285862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.285905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.286688] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.788528] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.788528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.788528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.788972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.788972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.788972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.789136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.789241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.789365] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.789476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.789668] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.789782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.789855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.790051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.790332] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.790469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.790551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.790708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.790818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.790919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.791060] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.983094] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 975.983983] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 976.292982] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60f68fd-25de-4d38-bc93-3e4066ff8aa6: rpc.has_security_group_logging(os_id): False [ 976.311439] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.311650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.311650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.311867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.311957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.312167] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.312266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.312325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.312473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.312548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.312727] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.312819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.312884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.313032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.313108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.313305] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.313395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.313452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.313585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.313657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.313742] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 976.378678] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.378788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.378869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.379109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.379277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.405082] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 976.979391] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: SUCCESS [ 976.979750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.422466] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 978.422843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.985758] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 980.985999] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 984.685550] env[65553]: INFO networking_nsxv3.common.synchronization [None req-38f1e288-a20a-40e7-a94a-f6c47b927ae1 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_rules [ 984.686097] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_rules [ 984.686403] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.686520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.686576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.687825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.687825] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.760877] env[65553]: INFO networking_nsxv3.common.synchronization [None req-87139c81-376a-4123-b728-2a579e6e83fa tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_rules [ 984.760877] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_rules [ 984.761051] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.761178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.211019] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.211218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.211299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.211520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.211611] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.211708] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f already deleted. [ 985.211789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.211943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.212112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.212200] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.628625] env[65553]: INFO networking_nsxv3.common.synchronization [req-b2b9b1f6-263d-4b17-bd1e-4df619cd1869 req-0713a490-0ce4-477f-a873-23cf57a01020 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_members [ 985.628783] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28be331c-2041-41ac-9f2a-5746e8762908 with Priority: HIGHEST for action security_group_members [ 985.629111] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-28be331c-2041-41ac-9f2a-5746e8762908 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.629231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.629293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.629535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.629655] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.629748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.629806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.629946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.631184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.631325] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28be331c-2041-41ac-9f2a-5746e8762908',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.737488] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.737805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.737805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.738209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.738337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.738440] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f already deleted. [ 985.738526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.136521] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.136666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.136736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.136960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.159250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.159714] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.159714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.159714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.159909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.159955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.160068] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28be331c-2041-41ac-9f2a-5746e8762908 is going to be updated. [ 986.189041] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.189041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.189226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.189325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.189543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.198919] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28be331c-2041-41ac-9f2a-5746e8762908 in Status: IN_PROGRESS for 2s [ 987.495647] env[65553]: INFO networking_nsxv3.common.synchronization [None req-9201a504-e0b3-4091-b1b7-a82bdb2811f6 None None] Enqueued Resource ID: 508d32c8-b368-4896-b843-ce1472d0ba58 with Priority: HIGHEST for action port [ 987.496554] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 508d32c8-b368-4896-b843-ce1472d0ba58 with Priority: HIGHEST for action port [ 987.496748] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-508d32c8-b368-4896-b843-ce1472d0ba58 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.496870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-508d32c8-b368-4896-b843-ce1472d0ba58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.496936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-508d32c8-b368-4896-b843-ce1472d0ba58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.497287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-508d32c8-b368-4896-b843-ce1472d0ba58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.497391] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('508d32c8-b368-4896-b843-ce1472d0ba58',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.003281] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 508d32c8-b368-4896-b843-ce1472d0ba58 [ 988.003281] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.003281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.003281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.003281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.003281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.003281] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:508d32c8-b368-4896-b843-ce1472d0ba58 already deleted. [ 988.003281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-508d32c8-b368-4896-b843-ce1472d0ba58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.212365] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28be331c-2041-41ac-9f2a-5746e8762908 in Status: SUCCESS [ 988.212554] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28be331c-2041-41ac-9f2a-5746e8762908 deletion is rescheduled due to dependency. [ 988.212732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28be331c-2041-41ac-9f2a-5746e8762908" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.227627] env[65553]: INFO networking_nsxv3.common.synchronization [None req-421b967f-a2ad-423d-8618-e5b9e8a2f935 None None] Enqueued Resource ID: f8d5e89c-97f3-4b58-b5d9-170456085217 with Priority: HIGHEST for action port [ 990.227627] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d5e89c-97f3-4b58-b5d9-170456085217 with Priority: HIGHEST for action port [ 990.227627] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8d5e89c-97f3-4b58-b5d9-170456085217 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.228283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8d5e89c-97f3-4b58-b5d9-170456085217" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.232372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8d5e89c-97f3-4b58-b5d9-170456085217" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.232372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8d5e89c-97f3-4b58-b5d9-170456085217" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.232372] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8d5e89c-97f3-4b58-b5d9-170456085217',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.733858] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8d5e89c-97f3-4b58-b5d9-170456085217 [ 990.733858] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.733858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.734217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.734217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.734217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.734510] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8d5e89c-97f3-4b58-b5d9-170456085217 already deleted. [ 990.734635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8d5e89c-97f3-4b58-b5d9-170456085217" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.601807] env[65553]: INFO networking_nsxv3.common.synchronization [req-c0d4a5eb-5bc5-4053-ac51-42f5e68dd7bf req-2b46148a-e3d9-40d7-8363-fbaaf278ca7f tempest-ServersAdminTestJSON-844759989 tempest-ServersAdminTestJSON-844759989-project-member] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 991.602297] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 991.602760] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.602902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.602975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.603208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.603429] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.603530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.603672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.603753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.603852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.604172] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.106711] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.609860] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.112484] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.112705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.112705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.112913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.113021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.113122] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 993.144538] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.144700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.144700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.144916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.145246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.155089] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 994.028776] env[65553]: INFO networking_nsxv3.common.synchronization [None req-51c98469-8e64-41b0-aec5-c04c9a5b0d36 None None] Enqueued Resource ID: ebae8aea-7f57-411c-ac45-8aab1adcca8f with Priority: HIGHEST for action port [ 994.029538] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebae8aea-7f57-411c-ac45-8aab1adcca8f with Priority: HIGHEST for action port [ 994.029782] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebae8aea-7f57-411c-ac45-8aab1adcca8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.029902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebae8aea-7f57-411c-ac45-8aab1adcca8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.029902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebae8aea-7f57-411c-ac45-8aab1adcca8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.030746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebae8aea-7f57-411c-ac45-8aab1adcca8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.030746] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebae8aea-7f57-411c-ac45-8aab1adcca8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.534414] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebae8aea-7f57-411c-ac45-8aab1adcca8f [ 994.534692] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.534804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.534853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.535223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.535332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.535432] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebae8aea-7f57-411c-ac45-8aab1adcca8f already deleted. [ 994.535510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebae8aea-7f57-411c-ac45-8aab1adcca8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.168944] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 995.169231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.571203] env[65553]: INFO networking_nsxv3.common.synchronization [req-1435aa13-842a-44c2-9b54-b538d9e03684 req-e5624bf1-cc33-45c1-a060-7cf9b63469ab tempest-ServersNegativeTestJSON-1019655983 tempest-ServersNegativeTestJSON-1019655983-project-member] Enqueued Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 995.572827] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 995.573539] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.573721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.573799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.573996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.574165] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.574299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.574399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.574561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.574644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.574737] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.954621] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-799 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.954869] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.954944] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.955222] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.955479] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.955628] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.955765] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.955946] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.956100] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.956310] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.956414] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.956519] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.956622] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.956728] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.956833] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.956954] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.978301] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.978536] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 995.978709] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.978911] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.979312] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-ca24bfa8-d03c-493c-8196-026c401080a7 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.979543] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-ca24bfa8-d03c-493c-8196-026c401080a7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.979705] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-ca24bfa8-d03c-493c-8196-026c401080a7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.980066] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-ca24bfa8-d03c-493c-8196-026c401080a7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.980247] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca24bfa8-d03c-493c-8196-026c401080a7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.083511] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.314033] env[65553]: INFO networking_nsxv3.common.synchronization [None req-84b622d1-1305-41cd-beeb-23dff07e9330 None None] Enqueued Resource ID: 709cd0fd-a968-4d0f-be76-d4a9e96b300c with Priority: HIGHEST for action port [ 996.314932] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 709cd0fd-a968-4d0f-be76-d4a9e96b300c with Priority: HIGHEST for action port [ 996.315322] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-709cd0fd-a968-4d0f-be76-d4a9e96b300c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.315451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-709cd0fd-a968-4d0f-be76-d4a9e96b300c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.315506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-709cd0fd-a968-4d0f-be76-d4a9e96b300c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.315842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-709cd0fd-a968-4d0f-be76-d4a9e96b300c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.315961] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('709cd0fd-a968-4d0f-be76-d4a9e96b300c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.482791] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.483163] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.483343] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.483837] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.483837] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.483995] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port ca24bfa8-d03c-493c-8196-026c401080a7 not found, creating... [ 996.484318] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.484519] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.484672] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.484923] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.485341] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.485684] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.485845] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.485961] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.486195] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.486335] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.486480] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: ca24bfa8-d03c-493c-8196-026c401080a7 is going to be created. [ 996.515782] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.516016] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.516165] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.516456] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.516808] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.517062] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-ca24bfa8-d03c-493c-8196-026c401080a7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.584238] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.817879] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 709cd0fd-a968-4d0f-be76-d4a9e96b300c [ 996.818192] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.818385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.818385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.818613] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.818742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.818809] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:709cd0fd-a968-4d0f-be76-d4a9e96b300c already deleted. [ 996.818866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-709cd0fd-a968-4d0f-be76-d4a9e96b300c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.088728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.090140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.090140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.090667] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.091412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.091412] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f is going to be updated. [ 997.123594] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.123594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.123594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.123594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.123594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.134032] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: IN_PROGRESS for 2s [ 997.221361] env[65553]: INFO networking_nsxv3.common.synchronization [req-1435aa13-842a-44c2-9b54-b538d9e03684 req-911e3b78-a0d6-44a3-9fe8-9dcbb34e27b0 service nova] Enqueued Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_rules [ 997.222231] env[65553]: INFO networking_nsxv3.common.synchronization [req-1435aa13-842a-44c2-9b54-b538d9e03684 req-911e3b78-a0d6-44a3-9fe8-9dcbb34e27b0 service nova] Enqueued Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 997.222231] env[65553]: INFO networking_nsxv3.common.synchronization [req-1435aa13-842a-44c2-9b54-b538d9e03684 req-911e3b78-a0d6-44a3-9fe8-9dcbb34e27b0 service nova] Enqueued Resource ID: ca24bfa8-d03c-493c-8196-026c401080a7 with Priority: HIGHEST for action port [ 997.223534] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_rules [ 997.223736] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 997.223948] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca24bfa8-d03c-493c-8196-026c401080a7 with Priority: HIGHEST for action port [ 997.224177] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.224293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.224417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.224565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.224647] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.225613] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.225754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.225921] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca24bfa8-d03c-493c-8196-026c401080a7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.226102] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca24bfa8-d03c-493c-8196-026c401080a7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.226152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca24bfa8-d03c-493c-8196-026c401080a7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.226321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca24bfa8-d03c-493c-8196-026c401080a7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.226396] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca24bfa8-d03c-493c-8196-026c401080a7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.568400] env[65553]: INFO networking_nsxv3.common.synchronization [req-e79cb9ab-93d5-49fd-b3d0-afada62bf8cd req-c1701fc2-b00f-40af-9cf8-26b9417881d5 tempest-ServerRescueTestJSON-981888117 tempest-ServerRescueTestJSON-981888117-project-member] Enqueued Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 997.569245] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 997.569599] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.569599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.569599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.569752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.569839] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.569943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.570014] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.570371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.570465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.570574] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.704889] env[65553]: INFO networking_nsxv3.common.synchronization [req-3cb6fffe-23cb-4271-a032-71820dec2986 req-0d2ab0aa-6cd4-4ed7-b17b-32c6d545a7fa tempest-ServersTestManualDisk-575149513 tempest-ServersTestManualDisk-575149513-project-member] Enqueued Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_members [ 997.705500] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGHEST for action security_group_members [ 997.706373] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a088526-39aa-4b85-a4b7-780ad374c69e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.706373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.706373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.706554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.706605] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.706708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.706770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.706917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.707011] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.707124] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.730311] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.730503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.730595] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca24bfa8-d03c-493c-8196-026c401080a7 with status ACTIVE [ 997.730755] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.730892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.730929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.731562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.731562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.731562] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.731562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.731562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.731807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.731807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.732149] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.732149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.732287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.732323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.732357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.732714] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca24bfa8-d03c-493c-8196-026c401080a7 is going to be updated. [ 997.756830] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.757111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.757111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.757358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.757494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.757651] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca24bfa8-d03c-493c-8196-026c401080a7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.073583] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.209885] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.210061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.210061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.210358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.210358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.210561] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.210666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.210703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.210968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.210968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.211269] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a088526-39aa-4b85-a4b7-780ad374c69e is going to be updated. [ 998.239659] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.239973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.239973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.240528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.240528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.249439] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a088526-39aa-4b85-a4b7-780ad374c69e in Status: IN_PROGRESS for 2s [ 998.576528] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.079155] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.079401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.079401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.079646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.079746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.079849] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b is going to be updated. [ 999.113495] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.113681] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.113775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.113932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.114083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.123707] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: IN_PROGRESS for 2s [ 999.145522] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: SUCCESS [ 999.145774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.145951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.146213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.146405] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.146524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.146587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.146763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.146813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.146906] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.649417] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.151871] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.260113] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a088526-39aa-4b85-a4b7-780ad374c69e in Status: SUCCESS [ 1000.260299] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a088526-39aa-4b85-a4b7-780ad374c69e deletion is rescheduled due to dependency. [ 1000.260411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.654141] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.654141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.654141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.654141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.654141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.654683] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f is going to be updated. [ 1000.684028] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.684028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.684028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.684284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.684284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.694819] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: IN_PROGRESS for 2s [ 1001.134608] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: SUCCESS [ 1001.134608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.705441] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: SUCCESS [ 1002.705746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.705965] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1002.706115] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1002.706189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.706386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.706571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.707024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.707024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.707024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.707263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.707263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.707422] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.209345] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.209693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.209866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.210139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.210338] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.210484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.210552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.210719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.210803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.210893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.211065] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.211162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.211219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.211354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.211496] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.211586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.211640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.211776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.211849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.211931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.212027] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.666102] env[65553]: INFO networking_nsxv3.common.synchronization [req-da9ba015-d91a-4185-9ecb-dedda9a90e88 req-d7de2118-636b-4506-b59c-c75048720c12 tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 1003.666781] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 1003.667331] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.667509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.667583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.667784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.667934] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.668057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.668106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.668330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.668927] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.668927] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.688043] env[65553]: INFO networking_nsxv3.common.synchronization [req-da9ba015-d91a-4185-9ecb-dedda9a90e88 req-d7de2118-636b-4506-b59c-c75048720c12 tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_rules [ 1003.688043] env[65553]: INFO networking_nsxv3.common.synchronization [req-da9ba015-d91a-4185-9ecb-dedda9a90e88 req-d7de2118-636b-4506-b59c-c75048720c12 tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 1003.688043] env[65553]: INFO networking_nsxv3.common.synchronization [req-da9ba015-d91a-4185-9ecb-dedda9a90e88 req-d7de2118-636b-4506-b59c-c75048720c12 tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 12e38a72-0ece-480e-ba69-6d43bb17ff6a with Priority: HIGHEST for action port [ 1003.688279] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_rules [ 1003.688338] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 1003.688537] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e38a72-0ece-480e-ba69-6d43bb17ff6a with Priority: HIGHEST for action port [ 1003.688764] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.688877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.688941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.689179] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.689268] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.690572] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.690572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.690572] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e38a72-0ece-480e-ba69-6d43bb17ff6a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.690572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.690572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.690955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.690955] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e38a72-0ece-480e-ba69-6d43bb17ff6a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.715467] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d5d7b40-1056-43d4-a9d4-099288f67f0f: rpc.has_security_group_logging(os_id): False [ 1003.736440] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.736644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.736644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.736871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.736961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.737307] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.737458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.737458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.737627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.737704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.737895] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.737989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.738064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.738246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.738369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.738471] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.738557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.738616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.738752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.738823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.738912] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f is going to be updated. [ 1003.807090] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.807090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.807090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.807090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.807090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.822327] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: IN_PROGRESS for 2s [ 1004.171494] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.192968] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.192968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.192968] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12e38a72-0ece-480e-ba69-6d43bb17ff6a with status ACTIVE [ 1004.193242] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.193242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.193329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.194053] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.194053] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.194053] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.194053] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.194318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.194358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.194441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.194647] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.194746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.194805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.194980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.195210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.195326] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12e38a72-0ece-480e-ba69-6d43bb17ff6a is going to be updated. [ 1004.222888] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.223051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.223172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.223361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.223486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.223646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.674048] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.177827] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.177827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.177827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.177827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.177827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.177827] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 is going to be updated. [ 1005.212377] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.212584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.212630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.212816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.213038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.224813] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: IN_PROGRESS for 2s [ 1005.841653] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: SUCCESS [ 1005.841937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.417023] env[65553]: INFO networking_nsxv3.common.synchronization [req-a3ae7856-6819-4be9-a33d-89880cd7cb9d req-b311d1e5-d7ef-4a2b-a9da-7b57eaf2043f tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 1006.417623] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 1006.418987] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.419104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.436030] env[65553]: INFO networking_nsxv3.common.synchronization [req-a3ae7856-6819-4be9-a33d-89880cd7cb9d req-b311d1e5-d7ef-4a2b-a9da-7b57eaf2043f tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_rules [ 1006.436206] env[65553]: INFO networking_nsxv3.common.synchronization [req-a3ae7856-6819-4be9-a33d-89880cd7cb9d req-b311d1e5-d7ef-4a2b-a9da-7b57eaf2043f tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 1006.436348] env[65553]: INFO networking_nsxv3.common.synchronization [req-a3ae7856-6819-4be9-a33d-89880cd7cb9d req-b311d1e5-d7ef-4a2b-a9da-7b57eaf2043f tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 12e38a72-0ece-480e-ba69-6d43bb17ff6a with Priority: HIGHEST for action port [ 1006.437087] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_rules [ 1006.437470] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 1006.437470] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e38a72-0ece-480e-ba69-6d43bb17ff6a with Priority: HIGHEST for action port [ 1006.437793] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.437910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.438130] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.438206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.438584] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e38a72-0ece-480e-ba69-6d43bb17ff6a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.438584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.438700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.438808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.438887] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e38a72-0ece-480e-ba69-6d43bb17ff6a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.514412] env[65553]: INFO networking_nsxv3.common.synchronization [req-8c54f0f3-a309-4d26-8d9d-b21ff7dadb35 req-d21bcd99-043b-4f84-8f2a-2ec9463462d6 tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_members [ 1006.514412] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGHEST for action security_group_members [ 1006.514818] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.515114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.515301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.515622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.515921] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.516162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.516862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.516862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.516862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.516862] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.717377] env[65553]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1006.717511] env[65553]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] NSXv3 Agent Agent loop - iteration:2 started [ 1006.795330] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d521de18-2d35-4e92-a3d5-a60546623eb9 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_rules [ 1006.795330] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_rules [ 1006.795330] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0381d463-a205-4270-82ca-0eb7d56637ee taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.795544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.795734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.796143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.797349] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0381d463-a205-4270-82ca-0eb7d56637ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.919340] env[65553]: INFO networking_nsxv3.common.synchronization [None req-53589eae-a528-4d3f-86f2-afdddf695be7 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_rules [ 1006.919808] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_rules [ 1006.920249] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0381d463-a205-4270-82ca-0eb7d56637ee taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.920774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.943304] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12e38a72-0ece-480e-ba69-6d43bb17ff6a with status ACTIVE [ 1006.943607] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.943762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.943860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.944199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.944321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.944569] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.944694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.944756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.944954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.945114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.946525] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.946662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.946748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.946953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.947498] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.947498] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12e38a72-0ece-480e-ba69-6d43bb17ff6a is going to be updated. [ 1006.972778] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.972923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.972990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.973431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.973573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.973749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12e38a72-0ece-480e-ba69-6d43bb17ff6a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.019823] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.020043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.020043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.020272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.045533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.045533] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.045533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.045533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.045533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.045533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.045533] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d is going to be updated. [ 1007.076883] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.077171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.077344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.077976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.077976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.092165] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d in Status: IN_PROGRESS for 2s [ 1007.175276] env[65553]: INFO networking_nsxv3.common.synchronization [req-344fa4e8-7919-4a00-8852-26ec976cf970 req-3682f39d-46a1-4e75-b708-df226f7cbd20 tempest-ServersNegativeTestJSON-1019655983 tempest-ServersNegativeTestJSON-1019655983-project-member] Enqueued Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 1007.175276] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 1007.175276] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.175500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.175500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.175562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.177019] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.177019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.177019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.177019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.177019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.177019] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.235693] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: SUCCESS [ 1007.238231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.238231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.238231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.238231] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.238231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.238231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.238231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.238231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.238231] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.324199] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.324434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.324434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.324674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.324782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.325135] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0381d463-a205-4270-82ca-0eb7d56637ee already deleted. [ 1007.325135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.325135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.325383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.325513] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0381d463-a205-4270-82ca-0eb7d56637ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.678943] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.739860] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.848108] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.848334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.848334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.848518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.848609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.848702] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0381d463-a205-4270-82ca-0eb7d56637ee already deleted. [ 1007.848782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.181190] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.244055] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.556955] env[65553]: INFO networking_nsxv3.common.synchronization [req-f5ef4063-77fa-431c-82f2-0d1bbe34a7f9 req-e0c365c9-4259-4569-9918-cb97a66099d8 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1008.558361] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1008.558361] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.558361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.558589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.558623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.558769] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.558862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.558920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.559089] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.559168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.559258] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.683861] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.684166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.684166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.684327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.684427] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.684528] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f is going to be updated. [ 1008.719673] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.719847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.719888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.720569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.720569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.733896] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: IN_PROGRESS for 2s [ 1008.746216] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.746601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.746894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.747571] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.748729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.748961] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 is going to be updated. [ 1008.783782] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.783782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.783782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.783782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.783782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.793503] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: IN_PROGRESS for 2s [ 1008.960442] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.960642] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.960765] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.961055] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.961313] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.961464] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.961577] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.961780] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.961917] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.963137] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.963263] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.963382] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.963566] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.966765] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.966765] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.966765] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.988026] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.988026] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1008.988223] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.988269] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.988591] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-2ea1f3f7-9000-489c-8faf-69c89ce2e3aa taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.988761] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-2ea1f3f7-9000-489c-8faf-69c89ce2e3aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.989911] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-2ea1f3f7-9000-489c-8faf-69c89ce2e3aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.990231] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-2ea1f3f7-9000-489c-8faf-69c89ce2e3aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.990377] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ea1f3f7-9000-489c-8faf-69c89ce2e3aa',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.062543] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.062543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.062543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.062543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.063888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.063888] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.063888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.063888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.066047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.066047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.066047] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f already deleted. [ 1009.066047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.103011] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d in Status: SUCCESS [ 1009.103206] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d deletion is rescheduled due to dependency. [ 1009.103321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.493328] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.493985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.493985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.493985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.494200] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.494200] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 2ea1f3f7-9000-489c-8faf-69c89ce2e3aa not found, creating... [ 1009.494433] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.494576] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.494689] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.495084] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.495084] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.495358] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.495509] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.495618] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.495824] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.495953] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.496161] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 2ea1f3f7-9000-489c-8faf-69c89ce2e3aa is going to be created. [ 1009.517335] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.517665] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.517869] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.518224] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.518555] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.518870] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-2ea1f3f7-9000-489c-8faf-69c89ce2e3aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.282252] env[65553]: INFO networking_nsxv3.common.synchronization [req-f5ef4063-77fa-431c-82f2-0d1bbe34a7f9 req-94084cbc-dde8-42e2-aafa-a2315941288f service nova] Enqueued Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_rules [ 1010.282571] env[65553]: INFO networking_nsxv3.common.synchronization [req-f5ef4063-77fa-431c-82f2-0d1bbe34a7f9 req-94084cbc-dde8-42e2-aafa-a2315941288f service nova] Enqueued Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1010.282622] env[65553]: INFO networking_nsxv3.common.synchronization [req-f5ef4063-77fa-431c-82f2-0d1bbe34a7f9 req-94084cbc-dde8-42e2-aafa-a2315941288f service nova] Enqueued Resource ID: 2ea1f3f7-9000-489c-8faf-69c89ce2e3aa with Priority: HIGHEST for action port [ 1010.283478] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_rules [ 1010.283734] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1010.283848] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ea1f3f7-9000-489c-8faf-69c89ce2e3aa with Priority: HIGHEST for action port [ 1010.284178] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.284314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.284384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.284595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.284684] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.286021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.286739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.286739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.286739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.286739] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.286739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.286739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.287012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.287012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.287012] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.288020] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ea1f3f7-9000-489c-8faf-69c89ce2e3aa taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.289290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ea1f3f7-9000-489c-8faf-69c89ce2e3aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.289290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ea1f3f7-9000-489c-8faf-69c89ce2e3aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.289654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ea1f3f7-9000-489c-8faf-69c89ce2e3aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.289654] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ea1f3f7-9000-489c-8faf-69c89ce2e3aa',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.744062] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: SUCCESS [ 1010.744281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.791082] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.791222] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.791424] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.796425] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ea1f3f7-9000-489c-8faf-69c89ce2e3aa with status ACTIVE [ 1010.796425] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.796425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.796425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.796425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.796425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.796425] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.796425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.796425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.796846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.796846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.796846] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.796846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.796846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.797129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.797129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.797129] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ea1f3f7-9000-489c-8faf-69c89ce2e3aa is going to be updated. [ 1010.807143] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: SUCCESS [ 1010.807330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.807416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.808028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.808028] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.808028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.808028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.808295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.808295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.808295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.808397] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.809148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.809342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.809546] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.809643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.809685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.809867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.809918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.809969] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.818334] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.818474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.818547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.818750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.818880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.819042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ea1f3f7-9000-489c-8faf-69c89ce2e3aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.034273] env[65553]: INFO networking_nsxv3.common.synchronization [req-54bfe39a-956e-4bc7-b4eb-d5d121204777 req-bf6bec1d-f334-41de-9165-2601545d1c2f tempest-ServerAddressesNegativeTestJSON-483691794 tempest-ServerAddressesNegativeTestJSON-483691794-project-member] Enqueued Resource ID: 69e29b7f-533c-4401-87fd-c37e43a88191 with Priority: HIGHEST for action security_group_members [ 1011.034804] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e29b7f-533c-4401-87fd-c37e43a88191 with Priority: HIGHEST for action security_group_members [ 1011.035123] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e29b7f-533c-4401-87fd-c37e43a88191 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.035268] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.035338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.035589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.035743] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.035839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.035919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.036470] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.036570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.036665] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e29b7f-533c-4401-87fd-c37e43a88191',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.089357] env[65553]: INFO networking_nsxv3.common.synchronization [req-138a0f16-0210-4003-a751-ea8ff68bd5be req-8a70fd63-836e-474a-a06b-984ad3fda19a tempest-AttachInterfacesUnderV243Test-427542926 tempest-AttachInterfacesUnderV243Test-427542926-project-member] Enqueued Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 1011.089911] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 with Priority: HIGHEST for action security_group_members [ 1011.090267] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-078f6ece-0f89-4be3-969f-f776c18c6fc6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.090413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.294178] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.313146] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.315766] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.424689] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-957 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.426100] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-957" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.426289] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-957" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.426641] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-957" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.427024] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.427500] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.428562] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.428859] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.429057] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.429311] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.429502] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.429691] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.429830] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.429968] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.430134] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.430753] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.450451] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.450643] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.450772] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.450949] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-957" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.451297] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-e5734c60-57e7-4560-807b-cdd1d5959177 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.451471] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-e5734c60-57e7-4560-807b-cdd1d5959177" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.451588] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-e5734c60-57e7-4560-807b-cdd1d5959177" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.451919] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-e5734c60-57e7-4560-807b-cdd1d5959177" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.452074] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5734c60-57e7-4560-807b-cdd1d5959177',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.541026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.541026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.541026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.541026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.541026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.541026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.541026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.541026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.541026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.541026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.541026] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e29b7f-533c-4401-87fd-c37e43a88191 already deleted. [ 1011.541026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.800124] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.800124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.800124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.800124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.800124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.800124] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f is going to be created. [ 1011.817568] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.823023] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 078f6ece-0f89-4be3-969f-f776c18c6fc6: rpc.has_security_group_logging(os_id): False [ 1011.825924] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.826084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.826156] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.826365] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.826525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.837156] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: UNINITIALIZED for 2s [ 1011.841533] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.841663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.841817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.841950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.842661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.842661] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.842661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.842661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.842661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.842661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.842898] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 is going to be updated. [ 1011.923523] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.923714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.923787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.924147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.924311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.941023] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: IN_PROGRESS for 2s [ 1011.954975] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.955264] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.955391] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.955783] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.955936] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.956111] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port e5734c60-57e7-4560-807b-cdd1d5959177 not found, creating... [ 1011.956438] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.956634] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.956787] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.957081] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.957282] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.957587] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.957776] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.957889] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.958299] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.958473] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.958618] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: e5734c60-57e7-4560-807b-cdd1d5959177 is going to be created. [ 1011.982045] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.982385] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.982488] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.982744] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.983017] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.983293] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-e5734c60-57e7-4560-807b-cdd1d5959177" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.320437] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.320437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.320437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.321061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.321156] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.321297] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 is going to be updated. [ 1012.360612] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.360612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.360612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.360612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.360612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.372506] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: IN_PROGRESS for 2s [ 1012.704740] env[65553]: INFO networking_nsxv3.common.synchronization [req-54bfe39a-956e-4bc7-b4eb-d5d121204777 req-43ed8b3c-f652-45ba-89c7-f7b3d49fa799 service nova] Enqueued Resource ID: 69e29b7f-533c-4401-87fd-c37e43a88191 with Priority: HIGHEST for action security_group_rules [ 1012.704740] env[65553]: INFO networking_nsxv3.common.synchronization [req-54bfe39a-956e-4bc7-b4eb-d5d121204777 req-43ed8b3c-f652-45ba-89c7-f7b3d49fa799 service nova] Enqueued Resource ID: 69e29b7f-533c-4401-87fd-c37e43a88191 with Priority: HIGHEST for action security_group_members [ 1012.704740] env[65553]: INFO networking_nsxv3.common.synchronization [req-54bfe39a-956e-4bc7-b4eb-d5d121204777 req-43ed8b3c-f652-45ba-89c7-f7b3d49fa799 service nova] Enqueued Resource ID: e5734c60-57e7-4560-807b-cdd1d5959177 with Priority: HIGHEST for action port [ 1012.704740] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e29b7f-533c-4401-87fd-c37e43a88191 with Priority: HIGHEST for action security_group_rules [ 1012.704911] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e29b7f-533c-4401-87fd-c37e43a88191 with Priority: HIGHEST for action security_group_members [ 1012.704988] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5734c60-57e7-4560-807b-cdd1d5959177 with Priority: HIGHEST for action port [ 1012.705308] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e29b7f-533c-4401-87fd-c37e43a88191 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.705416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.705496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.705699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.705827] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e29b7f-533c-4401-87fd-c37e43a88191',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.707110] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e29b7f-533c-4401-87fd-c37e43a88191 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.707173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.707225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.707413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.707594] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.707708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.707793] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.709520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.709673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.709798] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e29b7f-533c-4401-87fd-c37e43a88191',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.710620] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5734c60-57e7-4560-807b-cdd1d5959177 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.710733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5734c60-57e7-4560-807b-cdd1d5959177" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.710771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5734c60-57e7-4560-807b-cdd1d5959177" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.710917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5734c60-57e7-4560-807b-cdd1d5959177" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.710992] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5734c60-57e7-4560-807b-cdd1d5959177',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.213133] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e29b7f-533c-4401-87fd-c37e43a88191 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.213133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.213645] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69e29b7f-533c-4401-87fd-c37e43a88191',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.214632] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5734c60-57e7-4560-807b-cdd1d5959177 with status ACTIVE [ 1013.214853] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.214968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.215123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.215281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.215371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.215593] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.215694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.215757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.215916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.215994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.216201] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.216321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.216386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.216527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.216608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.216682] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5734c60-57e7-4560-807b-cdd1d5959177 is going to be updated. [ 1013.241624] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.241624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.241624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.241624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.241624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.241624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5734c60-57e7-4560-807b-cdd1d5959177" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.636868] env[65553]: INFO networking_nsxv3.common.synchronization [req-b59e7a14-945a-4993-bf8e-0186c1ff40c1 req-1db3601b-b7d5-4803-a1fb-7f054784baa4 tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1013.637177] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1013.637626] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.637760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.637849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.638081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.638263] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.638382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.638471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.638632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.638727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.638826] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.719085] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69e29b7f-533c-4401-87fd-c37e43a88191',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.849102] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: SUCCESS [ 1013.849320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.849495] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.849714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.849904] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.850033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.850392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.850392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.850392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.850392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.850602] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.960328] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: SUCCESS [ 1013.960760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.962868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.962868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.962868] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.968419] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.968725] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.968725] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.969182] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.969279] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.969374] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.969493] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.969657] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.969796] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.969998] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.970121] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.970228] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.970331] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.970436] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.970537] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.970659] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.988484] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.988484] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.988484] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.988667] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.988996] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-7c980478-785a-465a-9729-2e3729002a46 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.989179] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-7c980478-785a-465a-9729-2e3729002a46" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.989399] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-7c980478-785a-465a-9729-2e3729002a46" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.989522] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-7c980478-785a-465a-9729-2e3729002a46" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.989693] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c980478-785a-465a-9729-2e3729002a46',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.144426] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.144628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.144628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.144862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.144954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.145194] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.145299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.145361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.145510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.145586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.145669] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1014.178076] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.178243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.178348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.178535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.178676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.187181] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1014.221621] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.221621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.221621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.221621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.221859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.221859] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e29b7f-533c-4401-87fd-c37e43a88191 is going to be created. [ 1014.257587] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.257860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.257860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.258080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.258203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.278424] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e29b7f-533c-4401-87fd-c37e43a88191 in Status: UNINITIALIZED for 2s [ 1014.353027] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.383592] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 in Status: SUCCESS [ 1014.383843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.384059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.384308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.384535] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.384678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.384759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.384952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.385070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.385291] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.482602] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.482815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.482896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.483194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.483294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.483411] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 is going to be deleted. [ 1014.492324] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.492582] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.492684] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.492962] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.493151] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.493320] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 7c980478-785a-465a-9729-2e3729002a46 not found, creating... [ 1014.493602] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.493773] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.493901] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.494153] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.494291] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.494611] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.494769] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.494882] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.495117] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.495300] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.495429] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 7c980478-785a-465a-9729-2e3729002a46 is going to be created. [ 1014.516054] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.516362] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.516499] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.516812] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.517078] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.517365] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-7c980478-785a-465a-9729-2e3729002a46" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.557451] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.557695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.557695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.558872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.558990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.559148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.856456] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 066e3ae9-ef84-454d-bd16-ad65fcc46e8f: rpc.has_security_group_logging(os_id): False [ 1014.878241] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.878456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.878568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.878949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.879134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.879462] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.879635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.879738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.879960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.880191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.880346] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f is going to be created. [ 1014.888792] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.888792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.888792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.890805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.890805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.890805] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.890805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.890805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.890805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.890805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.890805] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 is going to be deleted. [ 1014.926196] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.926196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.926433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.926535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.926669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.926838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.927108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.927500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.927840] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.927979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.928088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.928359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.928473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.928590] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078f6ece-0f89-4be3-969f-f776c18c6fc6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.105325] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.105564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.105564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.105781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.105958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.122816] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: IN_PROGRESS for 2s [ 1015.252507] env[65553]: INFO networking_nsxv3.common.synchronization [req-b59e7a14-945a-4993-bf8e-0186c1ff40c1 req-d9944b31-d8a1-40e8-beb1-f1d14ebf0d27 service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 1015.252740] env[65553]: INFO networking_nsxv3.common.synchronization [req-b59e7a14-945a-4993-bf8e-0186c1ff40c1 req-d9944b31-d8a1-40e8-beb1-f1d14ebf0d27 service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1015.252924] env[65553]: INFO networking_nsxv3.common.synchronization [req-b59e7a14-945a-4993-bf8e-0186c1ff40c1 req-d9944b31-d8a1-40e8-beb1-f1d14ebf0d27 service nova] Enqueued Resource ID: 7c980478-785a-465a-9729-2e3729002a46 with Priority: HIGHEST for action port [ 1015.253610] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 1015.253748] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1015.253781] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c980478-785a-465a-9729-2e3729002a46 with Priority: HIGHEST for action port [ 1015.254120] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.254304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.254304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.254511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.254594] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.255499] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.255589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.255778] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c980478-785a-465a-9729-2e3729002a46 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.255870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c980478-785a-465a-9729-2e3729002a46" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.255931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c980478-785a-465a-9729-2e3729002a46" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.256951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c980478-785a-465a-9729-2e3729002a46" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.256951] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c980478-785a-465a-9729-2e3729002a46',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.432370] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.432370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.432370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.432370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.432370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.432370] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.432370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.432370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.432370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.432370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.432370] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078f6ece-0f89-4be3-969f-f776c18c6fc6 already deleted. [ 1015.432370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078f6ece-0f89-4be3-969f-f776c18c6fc6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.767229] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.767229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.767229] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c980478-785a-465a-9729-2e3729002a46 with status ACTIVE [ 1015.767229] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.767229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.767229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.767229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.767229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.767229] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.767229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.767229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.767229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.767229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.767229] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.767796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.767796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.767796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.767796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.767796] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c980478-785a-465a-9729-2e3729002a46 is going to be updated. [ 1015.786229] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.786481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.786481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.786666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.786804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.786960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c980478-785a-465a-9729-2e3729002a46" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.197656] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1016.197656] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 1016.197656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.198052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.198052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.198202] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.198363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.198447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.198630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.198773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.198835] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.289181] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e29b7f-533c-4401-87fd-c37e43a88191 in Status: SUCCESS [ 1016.289471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.290195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.290336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.290455] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.290590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.290680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.290821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.290943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.291074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.291074] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69e29b7f-533c-4401-87fd-c37e43a88191',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.701438] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.793641] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e29b7f-533c-4401-87fd-c37e43a88191 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.795910] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.795910] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e29b7f-533c-4401-87fd-c37e43a88191 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.795910] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.795910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.796719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.796719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.796719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.796719] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69e29b7f-533c-4401-87fd-c37e43a88191',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.136175] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: SUCCESS [ 1017.136395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.203984] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.299314] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69e29b7f-533c-4401-87fd-c37e43a88191: rpc.has_security_group_logging(os_id): False [ 1017.317634] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.317777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.317841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.318066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.318159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.318378] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.318476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.318538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.318693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.318769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.318941] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.319044] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.319105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.319242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.319314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.319489] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.319589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.319642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.319764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.319833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.319913] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e29b7f-533c-4401-87fd-c37e43a88191 is going to be created. [ 1017.392958] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.392958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.392958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.393160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.393372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.408163] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69e29b7f-533c-4401-87fd-c37e43a88191 in Status: IN_PROGRESS for 2s [ 1017.707619] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.707619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.707619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.707941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.708063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.708129] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1017.742731] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.742731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.742731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.742731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.743235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.753087] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1019.422761] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69e29b7f-533c-4401-87fd-c37e43a88191 in Status: SUCCESS [ 1019.423227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.766947] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1019.767230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.767452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.767687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.768264] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.768264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.768264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.768264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.768534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.768534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.768534] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.254581] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1020.254581] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1020.272166] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.273874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.273874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.273874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.273874] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.273874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.273874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.273874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.273874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.273874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.273874] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.274305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.274305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.274305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.274305] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.274429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.274429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.275959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.275959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.275959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.275959] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.778486] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9009da09-3880-4f06-b8cc-6f3ff62a7fbd: rpc.has_security_group_logging(os_id): False [ 1020.798977] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.802217] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.802217] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.802217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.803154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.803154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.803154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.803154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.803154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.803154] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1020.850078] env[65553]: INFO networking_nsxv3.common.synchronization [req-1cf8a515-889b-4aa0-84db-a3e45f7ad3a8 req-0b195116-2373-48aa-b178-9828e2ea67aa tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 1020.851437] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 1020.851805] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.851921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.851990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.853211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.853389] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.853502] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.853568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.853736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.853829] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.853918] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.879031] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.879031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.879031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.879031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.879031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.896281] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1021.025758] env[65553]: INFO networking_nsxv3.common.synchronization [req-da0c0568-ead9-42b6-b036-508d765842a8 req-ddc9a23b-658f-431f-be32-11464af1eb1f tempest-ServersAdminTestJSON-844759989 tempest-ServersAdminTestJSON-844759989-project-member] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 1021.027518] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGHEST for action security_group_members [ 1021.028297] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.028694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.029552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.029552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.029552] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.029552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.029552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.029842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.029842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.030339] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.288636] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.288636] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.288636] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.289217] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.290185] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.290185] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.290185] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.290185] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.290435] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.290474] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.290590] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.290698] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.290805] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.290914] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.291032] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.291166] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.345719] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.345907] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.055 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.346055] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.346229] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.346701] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-3bff4190-4863-4264-8c43-8cb18690340d taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.346836] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.346948] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.347293] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.347439] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bff4190-4863-4264-8c43-8cb18690340d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.356368] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.356516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.356587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.356813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.390559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.390826] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.390966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.391089] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.391234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.391308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.391430] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 is going to be updated. [ 1021.422708] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.422889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.423010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.423299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.423448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.435429] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: IN_PROGRESS for 2s [ 1021.533427] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.533627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.533701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.533917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.570284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.570284] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.570284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.570284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.570284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.570284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.570284] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be updated. [ 1021.612786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.612988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.613073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.613402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.613480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.626299] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: IN_PROGRESS for 2s [ 1021.849980] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.849980] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.849980] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.850367] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.850453] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.850575] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 3bff4190-4863-4264-8c43-8cb18690340d not found, creating... [ 1021.850963] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.851215] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.851394] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.851718] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.851929] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.852325] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.852480] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.852594] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.852806] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.852936] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.853082] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 3bff4190-4863-4264-8c43-8cb18690340d is going to be created. [ 1021.877452] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.877682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.877830] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.878165] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.878422] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.878648] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.550104] env[65553]: INFO networking_nsxv3.common.synchronization [req-1cf8a515-889b-4aa0-84db-a3e45f7ad3a8 req-1590e76b-a32b-47b1-97ef-5e3ce45f24bc service nova] Enqueued Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_rules [ 1022.550237] env[65553]: INFO networking_nsxv3.common.synchronization [req-1cf8a515-889b-4aa0-84db-a3e45f7ad3a8 req-1590e76b-a32b-47b1-97ef-5e3ce45f24bc service nova] Enqueued Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 1022.550378] env[65553]: INFO networking_nsxv3.common.synchronization [req-1cf8a515-889b-4aa0-84db-a3e45f7ad3a8 req-1590e76b-a32b-47b1-97ef-5e3ce45f24bc service nova] Enqueued Resource ID: 3bff4190-4863-4264-8c43-8cb18690340d with Priority: HIGHEST for action port [ 1022.550877] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_rules [ 1022.551019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 1022.551117] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bff4190-4863-4264-8c43-8cb18690340d with Priority: HIGHEST for action port [ 1022.551379] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.551498] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.551594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.551803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.551840] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.552972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.553093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.553296] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bff4190-4863-4264-8c43-8cb18690340d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.553378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.553472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.553660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.553719] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bff4190-4863-4264-8c43-8cb18690340d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.913645] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1022.914093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.055759] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.055887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.056098] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bff4190-4863-4264-8c43-8cb18690340d with status ACTIVE [ 1023.056267] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.056377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.056464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.056668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.056997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.056997] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.057155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.057155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.057294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.057361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.057579] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.057674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.057745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.057868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.057937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.058033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bff4190-4863-4264-8c43-8cb18690340d is going to be updated. [ 1023.079602] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.079830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.079830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.079982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.080129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.080280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.286430] env[65553]: INFO networking_nsxv3.common.synchronization [req-ba3c3151-c7b1-4b46-a17f-805ff92077f3 req-826306dc-9ee5-4823-883b-2a043c02606c tempest-InstanceActionsNegativeTestJSON-1990979116 tempest-InstanceActionsNegativeTestJSON-1990979116-project-member] Enqueued Resource ID: ba740e0c-2e37-407f-9332-eb55708d440c with Priority: HIGHEST for action security_group_members [ 1023.287084] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba740e0c-2e37-407f-9332-eb55708d440c with Priority: HIGHEST for action security_group_members [ 1023.287450] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba740e0c-2e37-407f-9332-eb55708d440c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.287617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.287710] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.287993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.288205] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.288373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.288436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.288634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.288748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.288845] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba740e0c-2e37-407f-9332-eb55708d440c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.449653] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: SUCCESS [ 1023.449982] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 deletion is rescheduled due to dependency. [ 1023.450250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.450465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.450746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.451087] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.451279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.451347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.451579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.451695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.451842] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.637591] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c96c798-8819-41b0-9168-410c415c2391 in Status: SUCCESS [ 1023.637788] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c96c798-8819-41b0-9168-410c415c2391 deletion is rescheduled due to dependency. [ 1023.637906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.659217] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-336 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.659471] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-336" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.659559] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-336" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.659977] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-336" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.661110] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.661288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.661407] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.661661] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.661808] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.665192] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.665319] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.665442] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.665539] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.665651] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.665754] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.665885] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.686315] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.686552] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.686601] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.686765] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-336" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.687102] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-c3647718-9b26-4350-a1e3-8749c2ed8a00 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.687277] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-c3647718-9b26-4350-a1e3-8749c2ed8a00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.687420] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-c3647718-9b26-4350-a1e3-8749c2ed8a00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.687773] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-c3647718-9b26-4350-a1e3-8749c2ed8a00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.687938] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3647718-9b26-4350-a1e3-8749c2ed8a00',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.791169] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.791454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.791454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.791640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.791640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.791833] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.791932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.791986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.792149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.792228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.792305] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba740e0c-2e37-407f-9332-eb55708d440c already deleted. [ 1023.792371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.954361] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.190530] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.190831] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.190875] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.191265] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.191525] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.191707] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port c3647718-9b26-4350-a1e3-8749c2ed8a00 not found, creating... [ 1024.191984] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.192172] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.192290] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.192563] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.192706] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.192999] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.193560] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.193560] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.193560] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.193730] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.193730] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: c3647718-9b26-4350-a1e3-8749c2ed8a00 is going to be created. [ 1024.215015] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.215251] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.215433] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.215641] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.215865] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.216101] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-c3647718-9b26-4350-a1e3-8749c2ed8a00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.457668] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.943184] env[65553]: INFO networking_nsxv3.common.synchronization [req-ba3c3151-c7b1-4b46-a17f-805ff92077f3 req-b622e2af-4491-4dae-a5f7-7e743518a58b service nova] Enqueued Resource ID: ba740e0c-2e37-407f-9332-eb55708d440c with Priority: HIGHEST for action security_group_rules [ 1024.943507] env[65553]: INFO networking_nsxv3.common.synchronization [req-ba3c3151-c7b1-4b46-a17f-805ff92077f3 req-b622e2af-4491-4dae-a5f7-7e743518a58b service nova] Enqueued Resource ID: ba740e0c-2e37-407f-9332-eb55708d440c with Priority: HIGHEST for action security_group_members [ 1024.943716] env[65553]: INFO networking_nsxv3.common.synchronization [req-ba3c3151-c7b1-4b46-a17f-805ff92077f3 req-b622e2af-4491-4dae-a5f7-7e743518a58b service nova] Enqueued Resource ID: c3647718-9b26-4350-a1e3-8749c2ed8a00 with Priority: HIGHEST for action port [ 1024.944627] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba740e0c-2e37-407f-9332-eb55708d440c with Priority: HIGHEST for action security_group_rules [ 1024.944941] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba740e0c-2e37-407f-9332-eb55708d440c with Priority: HIGHEST for action security_group_members [ 1024.945255] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3647718-9b26-4350-a1e3-8749c2ed8a00 with Priority: HIGHEST for action port [ 1024.945875] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba740e0c-2e37-407f-9332-eb55708d440c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.945985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.946242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.949514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.949514] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba740e0c-2e37-407f-9332-eb55708d440c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.949514] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba740e0c-2e37-407f-9332-eb55708d440c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.949514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.949514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.949514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.949514] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.949514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.949514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.949514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.949514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.949514] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba740e0c-2e37-407f-9332-eb55708d440c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.950428] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3647718-9b26-4350-a1e3-8749c2ed8a00 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.950428] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3647718-9b26-4350-a1e3-8749c2ed8a00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.950570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3647718-9b26-4350-a1e3-8749c2ed8a00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.950818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3647718-9b26-4350-a1e3-8749c2ed8a00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.950868] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3647718-9b26-4350-a1e3-8749c2ed8a00',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.960288] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.960507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.960507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.964879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.964879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.964879] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 is going to be updated. [ 1025.004421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.004421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.004421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.004421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.004421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.014469] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: IN_PROGRESS for 2s [ 1025.132935] env[65553]: INFO networking_nsxv3.common.synchronization [req-a762704b-7063-4e80-853b-93959c2b27c6 req-a90e8f06-97cf-470b-a900-195a05283fc2 tempest-ServerAddressesNegativeTestJSON-483691794 tempest-ServerAddressesNegativeTestJSON-483691794-project-member] Enqueued Resource ID: 69e29b7f-533c-4401-87fd-c37e43a88191 with Priority: HIGHEST for action security_group_members [ 1025.133800] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e29b7f-533c-4401-87fd-c37e43a88191 with Priority: HIGHEST for action security_group_members [ 1025.134339] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-69e29b7f-533c-4401-87fd-c37e43a88191 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.134501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.134614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.134913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.135152] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.135319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.135409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.135663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.135795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.135928] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69e29b7f-533c-4401-87fd-c37e43a88191',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.457170] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba740e0c-2e37-407f-9332-eb55708d440c taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.457300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.457604] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba740e0c-2e37-407f-9332-eb55708d440c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.460143] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3647718-9b26-4350-a1e3-8749c2ed8a00 with status ACTIVE [ 1025.460339] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.460468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.460557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.460777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.460869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.461110] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.461171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.461246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.461392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.461486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.461673] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.461760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.461812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.461954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.462045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.462154] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3647718-9b26-4350-a1e3-8749c2ed8a00 is going to be updated. [ 1025.486461] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.486633] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.486680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.486856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.486983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.487144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3647718-9b26-4350-a1e3-8749c2ed8a00" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.640814] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.641346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.641346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.642360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.642360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.642360] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.642360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.642360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.642614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.643566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.643566] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e29b7f-533c-4401-87fd-c37e43a88191 is going to be updated. [ 1025.698537] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.698734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.698734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.699096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.699096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.710051] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e29b7f-533c-4401-87fd-c37e43a88191 in Status: IN_PROGRESS for 2s [ 1025.960043] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba740e0c-2e37-407f-9332-eb55708d440c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.463246] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.463855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.464050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.464445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.464741] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.465033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba740e0c-2e37-407f-9332-eb55708d440c is going to be created. [ 1026.493396] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.493730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.493730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.493830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.493984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.505486] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba740e0c-2e37-407f-9332-eb55708d440c in Status: UNINITIALIZED for 2s [ 1027.025885] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: SUCCESS [ 1027.026236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.026546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.026889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.027110] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.027266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.027300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.027489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.027581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.027685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.027777] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.530872] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.531306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.531306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.531706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.531839] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.531975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.532336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.532336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.532474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.532528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.532936] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.532936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.532936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.533110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.533287] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.533387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.533444] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.533619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.534411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.534411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.534411] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.628247] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.628247] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.628247] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.628563] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.628724] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.628908] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.630014] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.630014] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.630014] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.630014] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.630014] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.630014] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.630014] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.630345] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.630345] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.630495] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.657556] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.657805] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.657956] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.658082] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.658695] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-00569db8-de30-4ca9-a37a-2a0021c8a0ee taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.658695] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.658695] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.658922] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.659172] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00569db8-de30-4ca9-a37a-2a0021c8a0ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.722360] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69e29b7f-533c-4401-87fd-c37e43a88191 in Status: SUCCESS [ 1027.722688] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69e29b7f-533c-4401-87fd-c37e43a88191 deletion is rescheduled due to dependency. [ 1027.722834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.001999] env[65553]: INFO networking_nsxv3.common.synchronization [req-b55f15c9-ad86-45fe-9905-4086815fec08 req-ace80f2c-935a-4408-8da2-156ec0055346 tempest-ServerRescueTestJSON-981888117 tempest-ServerRescueTestJSON-981888117-project-member] Enqueued Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 1028.002540] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGHEST for action security_group_members [ 1028.002855] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.003133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.003133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.003243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.003383] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.003477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.003536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.003680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.003762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.003852] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.036165] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd69ea1e-9ecd-47c1-b65c-87418794c033: rpc.has_security_group_logging(os_id): False [ 1028.055134] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.055378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.055378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.055655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.055747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.055965] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.056079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.056143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.056300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.056377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.056569] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.056666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.056729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.056854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.056925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.057125] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.057210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.057267] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.057402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.057538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.057624] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 is going to be updated. [ 1028.125378] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.125580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.125580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.126019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.126288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.139594] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: IN_PROGRESS for 2s [ 1028.162411] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.162411] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.162708] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.162776] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.162916] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.163438] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.163438] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.163622] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.163688] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.163816] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.164147] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.164259] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.164393] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.164676] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.164732] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.164829] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 00569db8-de30-4ca9-a37a-2a0021c8a0ee is going to be updated. [ 1028.211255] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.211506] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.211588] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.211871] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.212275] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.212780] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.507731] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.507912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.508036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.508607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.508607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.508607] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.508781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.508781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.508933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.509033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.509161] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b is going to be updated. [ 1028.521400] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba740e0c-2e37-407f-9332-eb55708d440c in Status: SUCCESS [ 1028.521608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.522228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.522441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.522700] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.522764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.522803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.522948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.523921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.523921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.523921] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba740e0c-2e37-407f-9332-eb55708d440c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.538807] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.539148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.539148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.539230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.539364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.548776] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: IN_PROGRESS for 2s [ 1028.885182] env[65553]: INFO networking_nsxv3.common.synchronization [req-ca6473b4-d1a7-4710-a458-4e1b75185c71 req-75817d41-6780-454e-b034-5d6a2160b176 service nova] Enqueued Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_rules [ 1028.885182] env[65553]: INFO networking_nsxv3.common.synchronization [req-ca6473b4-d1a7-4710-a458-4e1b75185c71 req-75817d41-6780-454e-b034-5d6a2160b176 service nova] Enqueued Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_members [ 1028.885182] env[65553]: INFO networking_nsxv3.common.synchronization [req-ca6473b4-d1a7-4710-a458-4e1b75185c71 req-75817d41-6780-454e-b034-5d6a2160b176 service nova] Enqueued Resource ID: 00569db8-de30-4ca9-a37a-2a0021c8a0ee with Priority: HIGHEST for action port [ 1028.885182] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_rules [ 1028.885182] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_members [ 1028.885182] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00569db8-de30-4ca9-a37a-2a0021c8a0ee with Priority: HIGHEST for action port [ 1028.891579] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2ef9829-ef49-436a-a11a-bae751628c4a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.891579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.891579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.891579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.891579] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.891579] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2ef9829-ef49-436a-a11a-bae751628c4a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.891579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.891579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.891579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.892195] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.892273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.892327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.892639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.892639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.892710] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.894819] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-00569db8-de30-4ca9-a37a-2a0021c8a0ee taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.894819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.894819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.894819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.894819] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00569db8-de30-4ca9-a37a-2a0021c8a0ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.026312] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba740e0c-2e37-407f-9332-eb55708d440c taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.026424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.026424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.026638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.026796] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.026926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.026989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.027142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.027224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.027310] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.027501] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba740e0c-2e37-407f-9332-eb55708d440c taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.027599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.027658] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.027802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.027935] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.028041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.028096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.028219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.028305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.028473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.028527] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba740e0c-2e37-407f-9332-eb55708d440c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.397692] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.399366] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2ef9829-ef49-436a-a11a-bae751628c4a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.399366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.399599] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00569db8-de30-4ca9-a37a-2a0021c8a0ee with status ACTIVE [ 1029.399805] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.399917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.400112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.400342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.400403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.400896] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.400896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.400896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.401108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.402330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.402330] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.402330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.402330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.402330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.402330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.402330] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00569db8-de30-4ca9-a37a-2a0021c8a0ee is going to be updated. [ 1029.429529] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.429743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.429743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.430468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.430468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.430930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00569db8-de30-4ca9-a37a-2a0021c8a0ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.530895] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba740e0c-2e37-407f-9332-eb55708d440c: rpc.has_security_group_logging(os_id): False [ 1029.560251] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.560654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.560654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.560732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.560767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.560967] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.561085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.561148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.561310] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.561393] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.561646] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.561765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.561894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.561971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.565228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.565541] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.565678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.565734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.565920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.566013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.566109] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba740e0c-2e37-407f-9332-eb55708d440c is going to be created. [ 1029.647808] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.647957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.648020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.648239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.648416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.665629] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba740e0c-2e37-407f-9332-eb55708d440c in Status: IN_PROGRESS for 2s [ 1029.905579] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.153616] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: SUCCESS [ 1030.153616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.412090] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.412302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.412406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.412664] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.412791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.412920] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2ef9829-ef49-436a-a11a-bae751628c4a is going to be updated. [ 1030.445190] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.445389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.445445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.445708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.445878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.456860] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2ef9829-ef49-436a-a11a-bae751628c4a in Status: IN_PROGRESS for 2s [ 1030.483367] env[65553]: INFO networking_nsxv3.common.synchronization [req-09b4785d-0b30-40ae-8eea-8ebc369e2602 req-a5c6f0e1-11a0-4e74-91c5-ddeb826ab8f4 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_members [ 1030.483367] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_members [ 1030.483367] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0381d463-a205-4270-82ca-0eb7d56637ee taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.483367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.483367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.483367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.483367] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.483367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.483924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.484280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.484517] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.484736] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0381d463-a205-4270-82ca-0eb7d56637ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.561266] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b in Status: SUCCESS [ 1030.561266] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b deletion is rescheduled due to dependency. [ 1030.561266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.876177] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.876419] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.876552] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.876815] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.877104] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.877264] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.877378] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.877695] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.877892] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.878161] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.878278] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.878384] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.878499] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.878598] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.878712] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.878881] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.899996] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.900240] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.900384] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.900717] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.901039] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-b64a05b6-9e8f-41c6-971a-88801c9a5b37 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.901257] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-b64a05b6-9e8f-41c6-971a-88801c9a5b37" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.901257] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-b64a05b6-9e8f-41c6-971a-88801c9a5b37" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.901567] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-b64a05b6-9e8f-41c6-971a-88801c9a5b37" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.901843] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b64a05b6-9e8f-41c6-971a-88801c9a5b37',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.987436] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.987691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.987766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.987988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.988094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.988312] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.988412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.988485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.988733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.989420] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.989420] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0381d463-a205-4270-82ca-0eb7d56637ee already deleted. [ 1030.989420] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.406941] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.406941] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.406941] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.407315] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.407315] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.407395] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port b64a05b6-9e8f-41c6-971a-88801c9a5b37 not found, creating... [ 1031.407878] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.408068] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.408231] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.408429] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.408645] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.408960] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.409261] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.409440] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.409562] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.409708] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.409844] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: b64a05b6-9e8f-41c6-971a-88801c9a5b37 is going to be created. [ 1031.451238] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.451511] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.451599] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.451864] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.452130] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.452366] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-b64a05b6-9e8f-41c6-971a-88801c9a5b37" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.680133] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba740e0c-2e37-407f-9332-eb55708d440c in Status: SUCCESS [ 1031.680567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.144462] env[65553]: INFO networking_nsxv3.common.synchronization [req-09b4785d-0b30-40ae-8eea-8ebc369e2602 req-07b8992b-ba3f-4929-be82-ce800952e098 service nova] Enqueued Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_rules [ 1032.144652] env[65553]: INFO networking_nsxv3.common.synchronization [req-09b4785d-0b30-40ae-8eea-8ebc369e2602 req-07b8992b-ba3f-4929-be82-ce800952e098 service nova] Enqueued Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_members [ 1032.144784] env[65553]: INFO networking_nsxv3.common.synchronization [req-09b4785d-0b30-40ae-8eea-8ebc369e2602 req-07b8992b-ba3f-4929-be82-ce800952e098 service nova] Enqueued Resource ID: b64a05b6-9e8f-41c6-971a-88801c9a5b37 with Priority: HIGHEST for action port [ 1032.145316] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_rules [ 1032.145537] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_members [ 1032.145725] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b64a05b6-9e8f-41c6-971a-88801c9a5b37 with Priority: HIGHEST for action port [ 1032.145891] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0381d463-a205-4270-82ca-0eb7d56637ee taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.146840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.146840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.146840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.146840] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0381d463-a205-4270-82ca-0eb7d56637ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.147171] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0381d463-a205-4270-82ca-0eb7d56637ee taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.147281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.147346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.147566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.147726] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.147820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.147874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.148026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.148108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.148195] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0381d463-a205-4270-82ca-0eb7d56637ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.149776] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-b64a05b6-9e8f-41c6-971a-88801c9a5b37 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.149776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b64a05b6-9e8f-41c6-971a-88801c9a5b37" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.149776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b64a05b6-9e8f-41c6-971a-88801c9a5b37" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.149776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b64a05b6-9e8f-41c6-971a-88801c9a5b37" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.149776] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b64a05b6-9e8f-41c6-971a-88801c9a5b37',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.471375] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2ef9829-ef49-436a-a11a-bae751628c4a in Status: SUCCESS [ 1032.471819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.472155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.472379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.472578] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.472693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.472774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.473084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.473195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.473285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.473376] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.654029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0381d463-a205-4270-82ca-0eb7d56637ee taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.654029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.654029] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0381d463-a205-4270-82ca-0eb7d56637ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.654029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b64a05b6-9e8f-41c6-971a-88801c9a5b37 with status ACTIVE [ 1032.654029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.654029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.654029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.654029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.654029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.654029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.654029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.654029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.654029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.654029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.655152] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.660509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.660509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.660509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.660509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.660509] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b64a05b6-9e8f-41c6-971a-88801c9a5b37 is going to be updated. [ 1032.684599] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.684972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.684972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.685086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.685182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.686069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b64a05b6-9e8f-41c6-971a-88801c9a5b37" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.979346] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.160441] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0381d463-a205-4270-82ca-0eb7d56637ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.195737] env[65553]: INFO networking_nsxv3.common.synchronization [req-c0686daa-381e-4b8d-a890-e992ffe5ec6a req-5d3a9a55-0210-49af-985e-db3a84c00fb1 tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 1033.196039] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 with Priority: HIGHEST for action security_group_members [ 1033.196548] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd69ea1e-9ecd-47c1-b65c-87418794c033 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.196705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.196790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.197052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.197446] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.197596] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.197643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.197805] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.197884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.198093] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd69ea1e-9ecd-47c1-b65c-87418794c033',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.251306] env[65553]: INFO networking_nsxv3.common.synchronization [req-c0686daa-381e-4b8d-a890-e992ffe5ec6a req-5d3a9a55-0210-49af-985e-db3a84c00fb1 tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 3bff4190-4863-4264-8c43-8cb18690340d with Priority: HIGHEST for action port [ 1033.251306] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bff4190-4863-4264-8c43-8cb18690340d with Priority: HIGHEST for action port [ 1033.251573] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bff4190-4863-4264-8c43-8cb18690340d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.251688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.251761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.251957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.252181] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bff4190-4863-4264-8c43-8cb18690340d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.484800] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2ef9829-ef49-436a-a11a-bae751628c4a: rpc.has_security_group_logging(os_id): False [ 1033.521740] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.521968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.522099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.522369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.523350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.524392] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.524892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.524892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.524892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.524892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.525057] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2ef9829-ef49-436a-a11a-bae751628c4a is going to be updated. [ 1033.588256] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.588256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.588256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.588256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.588256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.605725] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2ef9829-ef49-436a-a11a-bae751628c4a in Status: IN_PROGRESS for 2s [ 1033.663501] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.663754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.663850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.664168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.664333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.664453] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0381d463-a205-4270-82ca-0eb7d56637ee is going to be created. [ 1033.689891] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.690399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.690399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.690494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.690671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.701068] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.701362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.701362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.701593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.701721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.701963] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.702155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.702264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.702417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.702491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.702608] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 is going to be updated. [ 1033.714078] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0381d463-a205-4270-82ca-0eb7d56637ee in Status: UNINITIALIZED for 2s [ 1033.752119] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.752119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.752119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.752344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.752446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.753666] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bff4190-4863-4264-8c43-8cb18690340d with status ACTIVE [ 1033.753869] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.754086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.754170] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.754436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.754663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.754899] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.755017] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.755150] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.755391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.755391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.755718] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.755821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.755886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.756049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.756130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.756218] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bff4190-4863-4264-8c43-8cb18690340d is going to be updated. [ 1033.769314] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: IN_PROGRESS for 2s [ 1033.780340] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.780474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.780565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.780761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.781042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.781136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bff4190-4863-4264-8c43-8cb18690340d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.456988] env[65553]: INFO networking_nsxv3.common.synchronization [req-abe7f477-5e4a-4d39-82d5-f78dcd40f762 req-193c9b2a-6ad6-45ac-b56b-9b953ace621c tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1035.459368] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1035.459592] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.459782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.459942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.460148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.460400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.460688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.460688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.460898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.460989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.461137] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.621975] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2ef9829-ef49-436a-a11a-bae751628c4a in Status: SUCCESS [ 1035.622142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.725312] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0381d463-a205-4270-82ca-0eb7d56637ee in Status: SUCCESS [ 1035.725559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.725738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.725979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.726198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.726411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.726411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.726578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.726635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.726720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.726815] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0381d463-a205-4270-82ca-0eb7d56637ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.781445] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 in Status: SUCCESS [ 1035.781752] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd69ea1e-9ecd-47c1-b65c-87418794c033 deletion is rescheduled due to dependency. [ 1035.781752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd69ea1e-9ecd-47c1-b65c-87418794c033" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.842976] env[65553]: INFO networking_nsxv3.common.synchronization [None req-63139514-ac1c-4138-8ef7-d5489b887fd3 None None] Enqueued Resource ID: 70e04949-6854-4314-afae-e3a32cc0808f with Priority: HIGHEST for action port [ 1035.843373] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70e04949-6854-4314-afae-e3a32cc0808f with Priority: HIGHEST for action port [ 1035.843732] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-70e04949-6854-4314-afae-e3a32cc0808f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.847433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70e04949-6854-4314-afae-e3a32cc0808f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.847535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70e04949-6854-4314-afae-e3a32cc0808f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.847859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70e04949-6854-4314-afae-e3a32cc0808f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.847957] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70e04949-6854-4314-afae-e3a32cc0808f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.945456] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.945456] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.945456] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.946057] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.946545] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.946756] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.946914] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.947327] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.947431] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.947701] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.947821] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.947965] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.948123] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.948995] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.949403] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.950214] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.964201] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.973869] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.974108] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1035.974252] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.974424] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.974752] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-881bf9f7-3e19-466a-a07a-11883212883d taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.974965] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-881bf9f7-3e19-466a-a07a-11883212883d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.975183] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-881bf9f7-3e19-466a-a07a-11883212883d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.975579] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-881bf9f7-3e19-466a-a07a-11883212883d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.975725] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('881bf9f7-3e19-466a-a07a-11883212883d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.229612] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0381d463-a205-4270-82ca-0eb7d56637ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.358117] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70e04949-6854-4314-afae-e3a32cc0808f [ 1036.358117] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.358117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.358117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.358117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.358117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.358117] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70e04949-6854-4314-afae-e3a32cc0808f already deleted. [ 1036.358117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70e04949-6854-4314-afae-e3a32cc0808f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.469401] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.479394] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.479764] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.479988] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.480414] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.480672] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.480926] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 881bf9f7-3e19-466a-a07a-11883212883d not found, creating... [ 1036.484022] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.484022] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.484022] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.484022] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.484022] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.484022] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.484022] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.484022] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.484022] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.484859] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.484859] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 881bf9f7-3e19-466a-a07a-11883212883d is going to be created. [ 1036.510556] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.510799] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.510924] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.511241] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.511468] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.511691] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-881bf9f7-3e19-466a-a07a-11883212883d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.731943] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0381d463-a205-4270-82ca-0eb7d56637ee: rpc.has_security_group_logging(os_id): False [ 1036.757157] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.757381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.757499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.757898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.758073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.758450] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.758622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.758734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.758927] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.759110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.759245] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0381d463-a205-4270-82ca-0eb7d56637ee is going to be created. [ 1036.829572] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.830218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.830218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.830218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.830437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.843264] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0381d463-a205-4270-82ca-0eb7d56637ee in Status: IN_PROGRESS for 2s [ 1036.971016] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.971016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.971397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.971397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.971531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.971597] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f is going to be updated. [ 1037.034677] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.034882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.034954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.035202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.035450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.048947] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: IN_PROGRESS for 2s [ 1037.292069] env[65553]: INFO networking_nsxv3.common.synchronization [req-abe7f477-5e4a-4d39-82d5-f78dcd40f762 req-d29e0901-2ab7-4675-934f-071c9174a927 service nova] Enqueued Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_rules [ 1037.292363] env[65553]: INFO networking_nsxv3.common.synchronization [req-abe7f477-5e4a-4d39-82d5-f78dcd40f762 req-d29e0901-2ab7-4675-934f-071c9174a927 service nova] Enqueued Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1037.292363] env[65553]: INFO networking_nsxv3.common.synchronization [req-abe7f477-5e4a-4d39-82d5-f78dcd40f762 req-d29e0901-2ab7-4675-934f-071c9174a927 service nova] Enqueued Resource ID: 881bf9f7-3e19-466a-a07a-11883212883d with Priority: HIGHEST for action port [ 1037.294094] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_rules [ 1037.294094] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1037.294094] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881bf9f7-3e19-466a-a07a-11883212883d with Priority: HIGHEST for action port [ 1037.296650] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.296650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.296650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.296650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.296650] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.296986] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.297412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.297412] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-881bf9f7-3e19-466a-a07a-11883212883d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.298779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-881bf9f7-3e19-466a-a07a-11883212883d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.298779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-881bf9f7-3e19-466a-a07a-11883212883d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.298779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-881bf9f7-3e19-466a-a07a-11883212883d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.298779] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('881bf9f7-3e19-466a-a07a-11883212883d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.797579] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.798103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.803030] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 881bf9f7-3e19-466a-a07a-11883212883d with status ACTIVE [ 1037.803030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.803030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.803030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.803030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.803030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.803030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.803030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.803030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.803030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.803030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.803030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.803030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.803646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.803646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.803646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.803646] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 881bf9f7-3e19-466a-a07a-11883212883d is going to be updated. [ 1037.829830] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.830032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.830140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.830304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.830863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.830863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-881bf9f7-3e19-466a-a07a-11883212883d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.346272] env[65553]: INFO networking_nsxv3.common.synchronization [None req-e2701479-6866-4955-9c22-abfaa30a6404 None None] Enqueued Resource ID: a63028e6-97c3-4751-b618-7960dc339be9 with Priority: HIGHEST for action port [ 1038.349148] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63028e6-97c3-4751-b618-7960dc339be9 with Priority: HIGHEST for action port [ 1038.349148] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-a63028e6-97c3-4751-b618-7960dc339be9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.349148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a63028e6-97c3-4751-b618-7960dc339be9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.349148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a63028e6-97c3-4751-b618-7960dc339be9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.349319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a63028e6-97c3-4751-b618-7960dc339be9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.349435] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a63028e6-97c3-4751-b618-7960dc339be9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.540084] env[65553]: INFO networking_nsxv3.common.synchronization [None req-6cca48c5-a3a3-4402-9b77-b81e72439ac2 tempest-ServersTestJSON-941555489 tempest-ServersTestJSON-941555489-project-member] Enqueued Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_rules [ 1038.540084] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_rules [ 1038.540084] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87be6074-60bc-4100-998c-628cc41a4590 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.540084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.540084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.540637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.541013] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87be6074-60bc-4100-998c-628cc41a4590',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.634474] env[65553]: INFO networking_nsxv3.common.synchronization [req-e0c9257b-1f44-4aca-a55b-216da577889e req-67649e6c-46a7-428d-813a-fec6e3a07e4e tempest-InstanceActionsNegativeTestJSON-1990979116 tempest-InstanceActionsNegativeTestJSON-1990979116-project-member] Enqueued Resource ID: ba740e0c-2e37-407f-9332-eb55708d440c with Priority: HIGHEST for action security_group_members [ 1038.635277] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba740e0c-2e37-407f-9332-eb55708d440c with Priority: HIGHEST for action security_group_members [ 1038.635693] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba740e0c-2e37-407f-9332-eb55708d440c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.635821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.635879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.636115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.636285] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.636380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.636437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.636593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.636812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.636812] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba740e0c-2e37-407f-9332-eb55708d440c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.826020] env[65553]: INFO networking_nsxv3.common.synchronization [None req-71884da5-2d34-44c1-953e-491c7b92f0be tempest-ServersTestJSON-941555489 tempest-ServersTestJSON-941555489-project-member] Enqueued Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_rules [ 1038.826020] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_rules [ 1038.826020] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87be6074-60bc-4100-998c-628cc41a4590 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.826903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.854135] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a63028e6-97c3-4751-b618-7960dc339be9 [ 1038.854135] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.854135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.854135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.854135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.854135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.854135] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a63028e6-97c3-4751-b618-7960dc339be9 already deleted. [ 1038.854135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a63028e6-97c3-4751-b618-7960dc339be9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.856385] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0381d463-a205-4270-82ca-0eb7d56637ee in Status: SUCCESS [ 1038.860080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.063025] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: SUCCESS [ 1039.063025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.063025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.063025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.063025] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.063025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.063025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.063025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.063025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.063025] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.065363] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.065600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.065733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.065942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.066141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.066194] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87be6074-60bc-4100-998c-628cc41a4590 already deleted. [ 1039.066267] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.066449] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.066700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.066700] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87be6074-60bc-4100-998c-628cc41a4590',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.141410] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.141410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.141410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.141410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.141410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.141620] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.141814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.141814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.141975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.142068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.142191] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba740e0c-2e37-407f-9332-eb55708d440c is going to be updated. [ 1039.175729] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.175964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.176022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.176227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.176371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.193291] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba740e0c-2e37-407f-9332-eb55708d440c in Status: IN_PROGRESS for 2s [ 1039.566379] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.589632] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.590761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.590932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.591145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.591285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.591436] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87be6074-60bc-4100-998c-628cc41a4590 already deleted. [ 1039.591436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.069106] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.571791] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.572246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.572543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.572745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.572881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.573053] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f is going to be updated. [ 1040.619696] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.619955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.619955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.620329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.620421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.634698] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: IN_PROGRESS for 2s [ 1041.205514] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba740e0c-2e37-407f-9332-eb55708d440c in Status: SUCCESS [ 1041.205901] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba740e0c-2e37-407f-9332-eb55708d440c deletion is rescheduled due to dependency. [ 1041.205901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.443290] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f04d29a8-4ad8-4f8a-b730-b7575007ab66 tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: 03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2 with Priority: HIGHEST for action security_group_rules [ 1041.443884] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2 with Priority: HIGHEST for action security_group_rules [ 1041.444376] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.444535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.444535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.447078] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.447078] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.603291] env[65553]: INFO networking_nsxv3.common.synchronization [None req-3bb6f534-4f49-44ad-ac8e-6a3ae85759ba tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: 03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2 with Priority: HIGHEST for action security_group_rules [ 1041.605604] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2 with Priority: HIGHEST for action security_group_rules [ 1041.606666] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.606788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.973910] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.974132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.974372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.974372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.974451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.974562] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2 already deleted. [ 1041.974787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.974787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.974932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.975034] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.499032] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.499408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.499602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.500013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.500251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.500640] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2 already deleted. [ 1042.500754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03d3d6c1-4f5f-4c24-be25-15b1f0bc34b2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.648887] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: SUCCESS [ 1042.649230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.649506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.649828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.650119] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.650247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.650310] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.650559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.651030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.651208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.651396] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.747866] env[65553]: INFO networking_nsxv3.common.synchronization [req-c09ba573-99c9-4890-8f1d-ca1adba09e56 req-785f0333-7ef0-4d5d-9a3f-7baf8c933c02 tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1042.748861] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1042.748979] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.753157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.753399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.753755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.754032] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.758778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.758778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.758778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.758778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.758778] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.155188] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.260166] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.260248] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.260283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.260511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.260601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.260807] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.260910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.260988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.261139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.261212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.261337] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1043.297024] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.297024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.297024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.297024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.297024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.315972] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1043.656557] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 066e3ae9-ef84-454d-bd16-ad65fcc46e8f: rpc.has_security_group_logging(os_id): False [ 1043.677042] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.677042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.677042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.677276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.677276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.677454] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.677555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.677644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.677988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.678136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.678230] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f is going to be updated. [ 1043.746039] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.746199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.746282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.746556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.746691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.766313] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: IN_PROGRESS for 2s [ 1044.578247] env[65553]: INFO networking_nsxv3.common.synchronization [req-c0845dcd-8dff-49a4-ba76-ab8916871bdb req-f4f2720c-af68-47f3-95cb-4027d8b18b5d tempest-ServerActionsTestOtherB-2131075409 tempest-ServerActionsTestOtherB-2131075409-project-member] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1044.578247] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1044.578247] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.578247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.578247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.578465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.578689] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.578774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.578774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.578935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.580689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.580689] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.020791] env[65553]: INFO networking_nsxv3.common.synchronization [req-dd978363-8ae7-4090-8337-5c61e0a4494b req-582c70df-846a-4b61-a755-b9898892f3a3 tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1045.021379] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1045.021691] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.021824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.021897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.022131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.022254] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.022355] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.022416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.022563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.022640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.022735] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.084047] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.084193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.084258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.084474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.111883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.113584] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.113732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.113802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.114098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.114196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.114295] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be updated. [ 1045.162602] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.162602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.162817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.162937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.163103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.179338] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1045.329563] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1045.330463] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 1045.330463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.528910] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.529070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.529145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.529370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.529469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.529661] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.529756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.529853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.529965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.530062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.530178] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 1045.568674] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.568674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.568674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.568674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.568674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.583461] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 1045.785424] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: SUCCESS [ 1045.785568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.190541] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1047.190852] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a deletion is rescheduled due to dependency. [ 1047.190852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.596032] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 1047.596242] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 deletion is rescheduled due to dependency. [ 1047.596366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.135741] env[65553]: INFO networking_nsxv3.common.synchronization [None req-95a4b096-4a86-4e12-8b64-ca73b43f22ce tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 1048.136353] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 1048.136714] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.136855] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.136930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.137626] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.137626] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.138577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.138577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.139715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.139715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.139715] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.649022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.649022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.649022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.649022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.649022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.649022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.649022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.649022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.649022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.649022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.649022] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 1048.676334] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.679033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.679033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.679033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.679033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.692810] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 1050.707468] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 1050.707863] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 deletion is rescheduled due to dependency. [ 1050.707863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.769030] env[65553]: INFO networking_nsxv3.common.synchronization [req-ca5e93a1-0d97-474d-b98a-e8752f6e4e5d req-a9c96a7f-7ccd-4207-abaf-f56563ca0604 tempest-ServersTestJSON-941555489 tempest-ServersTestJSON-941555489-project-member] Enqueued Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_members [ 1052.770011] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_members [ 1052.770011] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-87be6074-60bc-4100-998c-628cc41a4590 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.770209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.770317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.771037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.771037] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.771037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.771037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.771323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.771323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.771449] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87be6074-60bc-4100-998c-628cc41a4590',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.135583] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-19 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.135833] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-19" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.135890] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-19" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.136657] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-19" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.136976] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.137199] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.137348] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.137625] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.137783] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.138267] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.138442] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.138583] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.138716] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.138857] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.139039] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.139370] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.161647] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.161866] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.162161] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.162405] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-19" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.162769] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.163026] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.163203] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.163597] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.163745] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.273842] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.274066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.274164] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.274419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.274516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.274770] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.274881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.274950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.275155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.275238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.275337] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87be6074-60bc-4100-998c-628cc41a4590 already deleted. [ 1053.275454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.666657] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.667019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.667111] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.667350] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.667498] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.667676] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee not found, creating... [ 1053.668066] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.668323] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.668393] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.668648] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.668789] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.669094] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.669253] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.669369] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.669579] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.669713] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.669851] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee is going to be created. [ 1053.692898] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.693245] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.693336] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.693705] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.694019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.694312] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.421386] env[65553]: INFO networking_nsxv3.common.synchronization [req-ca5e93a1-0d97-474d-b98a-e8752f6e4e5d req-4c8a5427-33f5-4c99-b99f-507d66cf0e79 service nova] Enqueued Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_rules [ 1054.421658] env[65553]: INFO networking_nsxv3.common.synchronization [req-ca5e93a1-0d97-474d-b98a-e8752f6e4e5d req-4c8a5427-33f5-4c99-b99f-507d66cf0e79 service nova] Enqueued Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_members [ 1054.421786] env[65553]: INFO networking_nsxv3.common.synchronization [req-ca5e93a1-0d97-474d-b98a-e8752f6e4e5d req-4c8a5427-33f5-4c99-b99f-507d66cf0e79 service nova] Enqueued Resource ID: bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee with Priority: HIGHEST for action port [ 1054.422351] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_rules [ 1054.422494] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_members [ 1054.422595] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee with Priority: HIGHEST for action port [ 1054.422894] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-87be6074-60bc-4100-998c-628cc41a4590 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.423065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.423136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.423509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.423613] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('87be6074-60bc-4100-998c-628cc41a4590',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.424563] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-87be6074-60bc-4100-998c-628cc41a4590 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.424665] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.424763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.425033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.425215] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.425323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.425389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.425549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.425639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.425759] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87be6074-60bc-4100-998c-628cc41a4590',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.426618] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.426750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.426850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.426983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.427086] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.928669] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('87be6074-60bc-4100-998c-628cc41a4590',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.929780] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-87be6074-60bc-4100-998c-628cc41a4590 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.929899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.930283] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee with status ACTIVE [ 1054.930385] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.930479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.930548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.930724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.930795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.930958] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.931097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.931130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.931414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.931414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.931513] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.931625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.931625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.931756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.932154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.932154] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee is going to be updated. [ 1054.954592] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.954866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.954866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.955029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.955128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.955283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdb4e1cc-a5d2-46b6-8bde-d8967b4f0bee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.430711] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('87be6074-60bc-4100-998c-628cc41a4590',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.933384] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.933570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.933632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.933847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.933938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.934063] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87be6074-60bc-4100-998c-628cc41a4590 is going to be created. [ 1055.964267] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.964460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.964460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.964648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.964804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.974457] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87be6074-60bc-4100-998c-628cc41a4590 in Status: UNINITIALIZED for 2s [ 1057.411089] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.411089] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.411089] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.411089] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.411640] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.411942] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.412185] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.412501] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.412744] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.413051] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.413262] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.413455] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.413640] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.413855] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.414075] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.414326] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.439702] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.439702] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.439702] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.439702] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.440199] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-72852e57-090e-47b1-8fa1-e6f92f7c6382 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.440320] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.440473] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.440832] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.440975] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72852e57-090e-47b1-8fa1-e6f92f7c6382',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.943942] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.944065] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.944163] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.944454] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.944643] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.944748] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 72852e57-090e-47b1-8fa1-e6f92f7c6382 not found, creating... [ 1057.945016] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.945227] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.945289] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.945505] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.945635] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.945920] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.946150] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.946279] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.946523] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.946687] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.946827] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 72852e57-090e-47b1-8fa1-e6f92f7c6382 is going to be created. [ 1057.967335] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.967558] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.967693] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.968011] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.968280] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.968570] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.983882] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87be6074-60bc-4100-998c-628cc41a4590 in Status: SUCCESS [ 1057.984117] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.984271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.984493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.984672] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.984784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.984921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.984996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.985127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.985183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.985293] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('87be6074-60bc-4100-998c-628cc41a4590',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.488335] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('87be6074-60bc-4100-998c-628cc41a4590',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.763373] env[65553]: INFO networking_nsxv3.common.synchronization [req-2d608a00-feb8-44ce-bea7-3719946de275 req-d0dcfd0a-46ad-405e-8ccc-26ddfb054df6 service nova] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_rules [ 1058.763570] env[65553]: INFO networking_nsxv3.common.synchronization [req-2d608a00-feb8-44ce-bea7-3719946de275 req-d0dcfd0a-46ad-405e-8ccc-26ddfb054df6 service nova] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 1058.763713] env[65553]: INFO networking_nsxv3.common.synchronization [req-2d608a00-feb8-44ce-bea7-3719946de275 req-d0dcfd0a-46ad-405e-8ccc-26ddfb054df6 service nova] Enqueued Resource ID: 72852e57-090e-47b1-8fa1-e6f92f7c6382 with Priority: HIGHEST for action port [ 1058.764438] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_rules [ 1058.764823] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 1058.765073] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72852e57-090e-47b1-8fa1-e6f92f7c6382 with Priority: HIGHEST for action port [ 1058.765578] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.765799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.765896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.768214] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.768214] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.769019] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.769172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.769274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.769496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.770402] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.770402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.770402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.770402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.770402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.770402] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.771143] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-72852e57-090e-47b1-8fa1-e6f92f7c6382 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.772756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.772848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.773055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.773143] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72852e57-090e-47b1-8fa1-e6f92f7c6382',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.991483] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 87be6074-60bc-4100-998c-628cc41a4590: rpc.has_security_group_logging(os_id): False [ 1059.013160] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.013328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.013402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.013638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.013941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.014136] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.014136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.014321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.014414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.014493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.016044] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 87be6074-60bc-4100-998c-628cc41a4590 is going to be created. [ 1059.077382] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.077599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.077599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.077815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.078061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.090689] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87be6074-60bc-4100-998c-628cc41a4590 in Status: IN_PROGRESS for 2s [ 1059.214799] env[65553]: INFO networking_nsxv3.common.synchronization [req-bf773b68-6215-47ff-8236-43e7fafb7990 req-7f625927-174e-4a1e-b7f6-85645269e0e9 tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1059.215416] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1059.215765] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.215904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.215972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.216346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.216511] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.216608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.216670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.216845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.216953] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.217030] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.276295] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.276912] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.278176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.278176] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72852e57-090e-47b1-8fa1-e6f92f7c6382 with status ACTIVE [ 1059.278176] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.278176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.278176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.278527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.278527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.278717] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.278816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.278921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.279140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.279264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.279631] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.279631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.279631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.279777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.279833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.279912] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72852e57-090e-47b1-8fa1-e6f92f7c6382 is going to be updated. [ 1059.321272] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.321272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.321272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.321272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.321272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.322042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.661653] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.662135] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.662541] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.662940] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.663696] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.663883] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.663999] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.664344] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.664538] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.664988] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.664988] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.665185] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.665185] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.665436] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.665569] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.665730] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.688649] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.688963] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.689305] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.689640] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.690188] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-5087699f-f818-47f4-933f-09b65d6b2afb taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.690532] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-5087699f-f818-47f4-933f-09b65d6b2afb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.690801] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-5087699f-f818-47f4-933f-09b65d6b2afb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.691383] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-5087699f-f818-47f4-933f-09b65d6b2afb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.691658] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5087699f-f818-47f4-933f-09b65d6b2afb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.719045] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.719257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.719327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.719555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.719649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.719847] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.719949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.720010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.720255] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.720350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.720443] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 1059.752648] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.752648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.752648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.753040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.753040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.764573] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 1059.778206] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.194704] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.194966] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.195070] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.195369] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.195511] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.195668] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 5087699f-f818-47f4-933f-09b65d6b2afb not found, creating... [ 1060.195935] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.196272] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.196272] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.196468] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.196602] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.196883] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.197065] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.197184] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.197390] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.197523] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.197661] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 5087699f-f818-47f4-933f-09b65d6b2afb is going to be created. [ 1060.222518] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.222726] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.222869] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.223150] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.223366] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.223592] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-5087699f-f818-47f4-933f-09b65d6b2afb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.280818] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.281438] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.281532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.281747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.281840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.281940] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 1060.353448] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.353898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.353898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.354694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.354694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.364728] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 1060.980811] env[65553]: INFO networking_nsxv3.common.synchronization [req-bf773b68-6215-47ff-8236-43e7fafb7990 req-4379a333-c9d8-4b7f-a744-a6a3fff70f67 service nova] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_rules [ 1060.980811] env[65553]: INFO networking_nsxv3.common.synchronization [req-bf773b68-6215-47ff-8236-43e7fafb7990 req-4379a333-c9d8-4b7f-a744-a6a3fff70f67 service nova] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1060.981276] env[65553]: INFO networking_nsxv3.common.synchronization [req-bf773b68-6215-47ff-8236-43e7fafb7990 req-4379a333-c9d8-4b7f-a744-a6a3fff70f67 service nova] Enqueued Resource ID: 5087699f-f818-47f4-933f-09b65d6b2afb with Priority: HIGHEST for action port [ 1060.981433] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_rules [ 1060.981569] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1060.981665] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5087699f-f818-47f4-933f-09b65d6b2afb with Priority: HIGHEST for action port [ 1060.981927] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.982060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.982128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.982319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.982398] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.983218] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.983342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.983548] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-5087699f-f818-47f4-933f-09b65d6b2afb taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.983650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5087699f-f818-47f4-933f-09b65d6b2afb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.983730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5087699f-f818-47f4-933f-09b65d6b2afb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.983904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5087699f-f818-47f4-933f-09b65d6b2afb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.983977] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5087699f-f818-47f4-933f-09b65d6b2afb',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.106231] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 87be6074-60bc-4100-998c-628cc41a4590 in Status: SUCCESS [ 1061.106537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.487384] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.487546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.487860] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5087699f-f818-47f4-933f-09b65d6b2afb with status ACTIVE [ 1061.487950] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.488070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.488174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.488422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.488551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.488761] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.488883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.488947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.489242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.489333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.489557] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.489672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.490235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.490235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.490235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.490235] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5087699f-f818-47f4-933f-09b65d6b2afb is going to be updated. [ 1061.514585] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.515098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.515098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.515247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.515479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.515739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5087699f-f818-47f4-933f-09b65d6b2afb" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.652752] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.652752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.652752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.652752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.652752] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.665214] env[65553]: INFO networking_nsxv3.common.synchronization [req-08101fd8-486e-479d-90c7-230ca58fdea2 req-cdbf40a2-5143-4348-b1ac-86a8607f2293 tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 1061.665214] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 1061.666470] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.666890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.667099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.668085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.668085] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.668085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.668085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.668085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.668085] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.668556] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.779599] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 1061.780038] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 deletion is rescheduled due to dependency. [ 1061.780038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.780258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.780931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.780931] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.781372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.781591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.781837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.782018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.782274] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.121405] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.121872] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.121872] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.123571] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.123571] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.126291] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.126467] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.126765] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.126913] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.127214] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.127375] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.127553] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.127709] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.127895] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.128084] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.128292] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.152696] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.152986] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.153264] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.153480] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-58" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.153854] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-ac70ffc4-56c0-46fa-99ad-faf85d02f7aa taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.154072] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-ac70ffc4-56c0-46fa-99ad-faf85d02f7aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.154161] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-ac70ffc4-56c0-46fa-99ad-faf85d02f7aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.154519] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-ac70ffc4-56c0-46fa-99ad-faf85d02f7aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.154642] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac70ffc4-56c0-46fa-99ad-faf85d02f7aa',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.155998] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.172978] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.285990] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.380864] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 1062.381095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.381283] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.381506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.381703] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.381912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.381988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.382162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.382243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.382331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.382420] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.658841] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.662355] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.662355] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.662355] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.662748] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.663113] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.663584] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port ac70ffc4-56c0-46fa-99ad-faf85d02f7aa not found, creating... [ 1062.664238] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.664596] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.664776] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.665134] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.665350] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.665820] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.666104] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.666292] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.667081] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.667081] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.667081] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: ac70ffc4-56c0-46fa-99ad-faf85d02f7aa is going to be created. [ 1062.678174] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.694027] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.694027] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.694027] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.694027] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.694027] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.694027] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-ac70ffc4-56c0-46fa-99ad-faf85d02f7aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.789162] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.885207] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.885337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.887095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.887095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.887095] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.887095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.887095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.887095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.887095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.887683] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.887866] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.888082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.888177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.888323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.888482] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.889042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.889042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.889042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.889042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.889042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.889454] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.173192] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1063.173192] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1063.180445] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.180889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.180960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.181191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.181277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.181379] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 is going to be updated. [ 1063.214284] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.214544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.214544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.214758] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.214908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.227095] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: IN_PROGRESS for 2s [ 1063.293915] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.294133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.294133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.294424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.294578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.294693] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 1063.348044] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.348187] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.348258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.348513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.348703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.361495] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 1063.393221] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4ee4c50-7cd1-464f-8791-a617053e06f6: rpc.has_security_group_logging(os_id): False [ 1063.441207] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.441412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.441485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.442160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.442160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.442160] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.442160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.442160] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.442456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.442456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.444048] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.444048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.444048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.444048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.444048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.444048] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.444048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.444048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.444048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.444048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.444048] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 1063.639543] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.639766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.639819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.640047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.640265] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.658108] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 1064.346153] env[65553]: INFO networking_nsxv3.common.synchronization [req-08101fd8-486e-479d-90c7-230ca58fdea2 req-effc1c21-e653-405f-a036-025b0425e59c service nova] Enqueued Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_rules [ 1064.346484] env[65553]: INFO networking_nsxv3.common.synchronization [req-08101fd8-486e-479d-90c7-230ca58fdea2 req-effc1c21-e653-405f-a036-025b0425e59c service nova] Enqueued Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 1064.347329] env[65553]: INFO networking_nsxv3.common.synchronization [req-08101fd8-486e-479d-90c7-230ca58fdea2 req-effc1c21-e653-405f-a036-025b0425e59c service nova] Enqueued Resource ID: ac70ffc4-56c0-46fa-99ad-faf85d02f7aa with Priority: HIGHEST for action port [ 1064.348092] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_rules [ 1064.348092] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 1064.348092] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac70ffc4-56c0-46fa-99ad-faf85d02f7aa with Priority: HIGHEST for action port [ 1064.348242] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.348337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.348388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.348636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.348713] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.354518] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.354518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.354518] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac70ffc4-56c0-46fa-99ad-faf85d02f7aa taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.354518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac70ffc4-56c0-46fa-99ad-faf85d02f7aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.354518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac70ffc4-56c0-46fa-99ad-faf85d02f7aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.354518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac70ffc4-56c0-46fa-99ad-faf85d02f7aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.354518] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac70ffc4-56c0-46fa-99ad-faf85d02f7aa',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.377503] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.377703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.377769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.379898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.395900] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1064.397041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.398302] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1064.450868] env[65553]: INFO networking_nsxv3.common.synchronization [req-415bc35b-1820-412b-9997-52c0c1b41aa1 req-326f2ebd-17dd-47e2-a774-3aaf3c2d8cd7 tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1064.452455] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1064.452455] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.452455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.452676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.452818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.453146] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.453227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.453262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.453490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.453679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.453849] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.460623] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.460623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.460623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.460623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.474720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.475456] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1064.475566] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.475676] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1064.537687] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.537908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.538018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.538968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.540854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.541147] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1064.665700] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.665930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.665930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.666143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.666673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.667422] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1064.784212] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.784375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.784446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.784673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.784984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.785310] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:51. [ 1064.785442] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'330e4cbb-c145-4a73-968c-26c6765a2388', 'd1246751-d3c4-4099-b16f-aa9fe0e1b1a6', 'd71eb658-afb5-408d-a69d-dac4485c2f2e', '2ed73c0e-357c-432a-a683-eda251f6d85a', '118c9912-ceb9-4aa1-bdf0-c6f83f3943b5', 'f4ee4c50-7cd1-464f-8791-a617053e06f6', 'f80555d1-ee88-4624-af40-5a9e62b1a6a6', '424e0166-59a6-441d-abf8-1fa9f2584819', 'c60427c8-0bdd-4ef0-a14a-b6e54b6e072b', '5c7019e3-cf34-4117-9224-cf7758cc0cf6', 'a86c04db-ddf8-419d-8a90-125d10e637f6', 'd069dc70-d382-4790-b884-3c9bf5e88eb0', '5a088526-39aa-4b85-a4b7-780ad374c69e', '5f345373-ada8-463f-8791-7b6fdbbaba03', '69e29b7f-533c-4401-87fd-c37e43a88191', '0c96c798-8819-41b0-9168-410c415c2391', '18b16119-4a62-4859-895e-b0f3732128ff', '9009da09-3880-4f06-b8cc-6f3ff62a7fbd', '015f5088-3b94-432c-9304-6fd98b4fe26a', '94e47e7e-ac8d-4d4a-ae5c-fb266118b21d', 'fb67cc18-9ceb-429a-844d-a60317217b7b', '15032a54-f6e7-41b8-855b-0262e8fb39c5', '4a425597-2f3a-4763-9abe-b15432eceec7', 'ba740e0c-2e37-407f-9332-eb55708d440c', '47ac6222-df91-40b6-8703-f88ab52afe33', 'ed7cc46a-1914-49e3-8b7d-d67e2682c5f6', 'de664cf7-0945-48b8-9372-6d843b23be0e', '84881d5c-05c0-4bde-84e9-437b2da92669', '30f1992f-8f85-4326-932f-434571d97d70', '510c04b8-85b7-4488-b4cf-5880529fe0b5', '5dd4fd13-5d20-444e-a455-6722e01bb869', '87be6074-60bc-4100-998c-628cc41a4590', 'b7d6f932-0d6e-4b85-a4f1-f60e841549d8', 'f3d9a09b-bf97-4de9-910d-f878fc6b267c', 'ec66a418-d823-4b2f-87e2-c61e09ea9de4', '0381d463-a205-4270-82ca-0eb7d56637ee', '54d93d69-4c1f-45f9-bd84-41ef7facb6ae', '76312788-a044-46c4-912d-a43bc9c8e59f', '762d4374-c484-417a-aad8-0a36a186516f', 'ebd49ee0-d72a-443f-a112-9fa0a970c7be', '28be331c-2041-41ac-9f2a-5746e8762908', 'ad458bc8-8a48-49a7-9f97-e510476fdf4f', 'a7ba6400-0dc9-4a80-ad83-aeeb3037ae85', 'd2ef9829-ef49-436a-a11a-bae751628c4a', '1e7647e8-bc93-4ca1-af77-c7da9c980011', 'b60f68fd-25de-4d38-bc93-3e4066ff8aa6', 'fd69ea1e-9ecd-47c1-b65c-87418794c033', '75ff2ed9-6e49-4d62-a3e7-345569ebb0f7', '9d5d7b40-1056-43d4-a9d4-099288f67f0f', '066e3ae9-ef84-454d-bd16-ad65fcc46e8f', '354651da-2fa6-41a7-a3bb-8655872e6da5'} {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.785571] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1064.813054] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.813054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.813054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.813306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.813533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.813533] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1064.813667] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.813667] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1064.867152] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.867152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.867152] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac70ffc4-56c0-46fa-99ad-faf85d02f7aa with status ACTIVE [ 1064.867152] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.867152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.867152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.867152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.867152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.867152] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.867152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.867152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.867152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.867152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.867152] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.868530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.868530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.868530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.868530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.868530] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac70ffc4-56c0-46fa-99ad-faf85d02f7aa is going to be updated. [ 1064.887012] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.887012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.887012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.891817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.892689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.892689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac70ffc4-56c0-46fa-99ad-faf85d02f7aa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.925489] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.925799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.925919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.926137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.928127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.928426] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1064.928500] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.928592] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1064.928664] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1064.928740] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/51 resources of Type:Security Group Rules [ 1064.928810] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGH for action security_group_rules [ 1064.930060] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGH for action security_group_rules [ 1064.930140] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGH for action security_group_rules [ 1064.930208] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGH for action security_group_rules [ 1064.930278] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 with Priority: HIGH for action security_group_rules [ 1064.930353] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGH for action security_group_rules [ 1064.930435] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 with Priority: HIGH for action security_group_rules [ 1064.930500] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGH for action security_group_rules [ 1064.930598] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGH for action security_group_rules [ 1064.930697] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGH for action security_group_rules [ 1064.930728] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGH for action security_group_rules [ 1064.931072] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGH for action security_group_rules [ 1064.931072] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGH for action security_group_rules [ 1064.931072] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGH for action security_group_rules [ 1064.931072] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69e29b7f-533c-4401-87fd-c37e43a88191 with Priority: HIGH for action security_group_rules [ 1064.931072] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGH for action security_group_rules [ 1064.931288] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGH for action security_group_rules [ 1064.931288] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGH for action security_group_rules [ 1064.931288] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGH for action security_group_rules [ 1064.931420] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGH for action security_group_rules [ 1064.931446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.950059] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.950059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.950059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.950059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.950059] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.950059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.950059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.950059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.950059] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.950059] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.950059] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.950059] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.950059] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.950659] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.950659] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.950659] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.957985] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.958189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.958258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.961163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.977372] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.977662] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1064.977824] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.978127] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.978453] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-968c321d-1324-4e76-89f9-3b7d2486d8fa taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.978679] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-968c321d-1324-4e76-89f9-3b7d2486d8fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.978867] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-968c321d-1324-4e76-89f9-3b7d2486d8fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.979361] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-968c321d-1324-4e76-89f9-3b7d2486d8fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.979503] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('968c321d-1324-4e76-89f9-3b7d2486d8fa',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.005503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.005836] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.005943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.005943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.006277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.006490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.006490] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1065.077297] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.077553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.077553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.077701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.077839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.088738] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1065.238465] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: IN_PROGRESS for 4s [ 1065.375513] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 1065.375894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.375926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.376292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.376505] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.376628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.376694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.376863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.376949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.377048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.377142] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.482587] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.482832] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.483088] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.483265] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.483434] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.483594] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 968c321d-1324-4e76-89f9-3b7d2486d8fa not found, creating... [ 1065.483858] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.484016] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.484134] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.484349] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.484481] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.484759] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.484909] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.485989] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.486350] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.486555] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.486884] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 968c321d-1324-4e76-89f9-3b7d2486d8fa is going to be created. [ 1065.509196] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.509486] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.509631] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.510013] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.510477] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.510477] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-968c321d-1324-4e76-89f9-3b7d2486d8fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.676993] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 1065.677320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.880768] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.880961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.881063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.881316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.881512] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.881647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.881699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.881835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.881919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.882020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.882176] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.882285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.882351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.882471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.882608] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.882742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.882799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.882891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.882964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.883053] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.883150] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.288957] env[65553]: INFO networking_nsxv3.common.synchronization [req-415bc35b-1820-412b-9997-52c0c1b41aa1 req-56cf630c-3309-4d92-b174-e7e63fae8a20 service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 1066.289524] env[65553]: INFO networking_nsxv3.common.synchronization [req-415bc35b-1820-412b-9997-52c0c1b41aa1 req-56cf630c-3309-4d92-b174-e7e63fae8a20 service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1066.289873] env[65553]: INFO networking_nsxv3.common.synchronization [req-415bc35b-1820-412b-9997-52c0c1b41aa1 req-56cf630c-3309-4d92-b174-e7e63fae8a20 service nova] Enqueued Resource ID: 968c321d-1324-4e76-89f9-3b7d2486d8fa with Priority: HIGHEST for action port [ 1066.290783] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 1066.291189] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1066.291918] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 968c321d-1324-4e76-89f9-3b7d2486d8fa with Priority: HIGHEST for action port [ 1066.292173] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330e4cbb-c145-4a73-968c-26c6765a2388 with Priority: HIGH for action security_group_rules [ 1066.292405] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71eb658-afb5-408d-a69d-dac4485c2f2e with Priority: HIGH for action security_group_rules [ 1066.292835] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 with Priority: HIGH for action security_group_rules [ 1066.293088] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69e29b7f-533c-4401-87fd-c37e43a88191 with Priority: HIGH for action security_group_rules [ 1066.295375] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d with Priority: HIGH for action security_group_rules [ 1066.295621] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b16119-4a62-4859-895e-b0f3732128ff with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c96c798-8819-41b0-9168-410c415c2391 with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a088526-39aa-4b85-a4b7-780ad374c69e with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86c04db-ddf8-419d-8a90-125d10e637f6 with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 424e0166-59a6-441d-abf8-1fa9f2584819 with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed73c0e-357c-432a-a683-eda251f6d85a with Priority: HIGH for action security_group_rules [ 1066.298019] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.298019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.298019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.298870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.299093] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.304508] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.307118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.307118] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-968c321d-1324-4e76-89f9-3b7d2486d8fa taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.307118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-968c321d-1324-4e76-89f9-3b7d2486d8fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.307118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-968c321d-1324-4e76-89f9-3b7d2486d8fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.307118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-968c321d-1324-4e76-89f9-3b7d2486d8fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.307118] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('968c321d-1324-4e76-89f9-3b7d2486d8fa',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.307708] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-330e4cbb-c145-4a73-968c-26c6765a2388 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.308032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.308329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.309936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.310146] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('330e4cbb-c145-4a73-968c-26c6765a2388',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.311731] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d71eb658-afb5-408d-a69d-dac4485c2f2e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.312031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.312231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.315890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.315890] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d71eb658-afb5-408d-a69d-dac4485c2f2e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.315890] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f80555d1-ee88-4624-af40-5a9e62b1a6a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.315890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.315890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.315890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.315890] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f80555d1-ee88-4624-af40-5a9e62b1a6a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.325885] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69e29b7f-533c-4401-87fd-c37e43a88191 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.325885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.326406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.326406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.326518] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69e29b7f-533c-4401-87fd-c37e43a88191',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.329195] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.329195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.329195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.329195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.329195] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94e47e7e-ac8d-4d4a-ae5c-fb266118b21d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.330819] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.331033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.331180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.332029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.332029] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.333217] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.333456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.333776] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18b16119-4a62-4859-895e-b0f3732128ff taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.333991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.334140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.334374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.334981] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18b16119-4a62-4859-895e-b0f3732128ff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.335596] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f345373-ada8-463f-8791-7b6fdbbaba03 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.335725] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.336066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.336264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.336568] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f345373-ada8-463f-8791-7b6fdbbaba03',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.338061] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c96c798-8819-41b0-9168-410c415c2391 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.338231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.338321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.338512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.338677] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c96c798-8819-41b0-9168-410c415c2391',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.339491] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a088526-39aa-4b85-a4b7-780ad374c69e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.339601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.339668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.339824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.339896] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a088526-39aa-4b85-a4b7-780ad374c69e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.340649] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d069dc70-d382-4790-b884-3c9bf5e88eb0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.340781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.340880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.341049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.341193] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d069dc70-d382-4790-b884-3c9bf5e88eb0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.342332] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86c04db-ddf8-419d-8a90-125d10e637f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.342332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.342332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.342512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.342561] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86c04db-ddf8-419d-8a90-125d10e637f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.343400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.343504] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.343547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.343688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.343763] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c7019e3-cf34-4117-9224-cf7758cc0cf6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.344606] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.344701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.344701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.344853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.344922] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c60427c8-0bdd-4ef0-a14a-b6e54b6e072b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.345691] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.345900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.345900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.346380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.346380] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.347068] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-424e0166-59a6-441d-abf8-1fa9f2584819 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.347761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.347761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.347761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.347761] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('424e0166-59a6-441d-abf8-1fa9f2584819',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.348191] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.348346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.348589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.348589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.348664] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('118c9912-ceb9-4aa1-bdf0-c6f83f3943b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.349500] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.349647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.349811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.349934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.350052] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.351382] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ed73c0e-357c-432a-a683-eda251f6d85a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.351726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.351726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.352315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.352315] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ed73c0e-357c-432a-a683-eda251f6d85a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.379941] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.379941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.379941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.379941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.387496] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60f68fd-25de-4d38-bc93-3e4066ff8aa6: rpc.has_security_group_logging(os_id): False [ 1066.411896] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.412140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.414349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.414434] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 330e4cbb-c145-4a73-968c-26c6765a2388 is going to be deleted. [ 1066.415906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.416178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.450025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.450025] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.450493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.450493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.450662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.450662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.450900] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.451032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.451081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.451237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.451312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.451534] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.451649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.451712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.451879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.451952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.452045] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 1066.488659] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.488833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.488908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.489185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.489277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.489389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-330e4cbb-c145-4a73-968c-26c6765a2388" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.535361] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.535535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.535572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.535767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.535906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.560205] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 1066.856734] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.857473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.857473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.857619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.857723] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.857840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.857932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.858205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.858367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.858484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.858546] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.862409] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.862609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.862712] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 968c321d-1324-4e76-89f9-3b7d2486d8fa with status ACTIVE [ 1066.862875] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.862968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.863488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.863488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.863488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.863595] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.863683] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.863789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.864285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.864285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.864389] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.864460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.864507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.864961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.864961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.864961] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 968c321d-1324-4e76-89f9-3b7d2486d8fa is going to be updated. [ 1066.887633] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.887812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.887857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.888079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.888258] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.888383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.888463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.888647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.888746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.888837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.888929] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.958765] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.958956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.958996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.959422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.961748] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.961923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.962810] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.962922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.963708] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.963833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.965431] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.965431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.965551] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.965617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.966356] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.966441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.967154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.967242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.967988] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.968119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.968912] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.969014] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.969719] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.969810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.970894] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1066.971405] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.971510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.972229] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1066.972655] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.972745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.973404] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1066.973820] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.973924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.974577] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1066.975044] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.975175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.975834] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1066.976262] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.976360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.977147] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1066.977622] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.977763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.977817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.979775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.979775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.979775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-968c321d-1324-4e76-89f9-3b7d2486d8fa" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.992080] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1066.992778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.992951] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18b16119-4a62-4859-895e-b0f3732128ff is going to be deleted. [ 1066.994487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.994719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.005674] env[65553]: INFO networking_nsxv3.common.synchronization [req-19f5ef7b-ca86-4842-bd7d-09ebe9e75bb3 req-8ac059c9-33f3-4c17-8938-6f099ea062e5 tempest-ServerActionsTestOtherB-2131075409 tempest-ServerActionsTestOtherB-2131075409-project-member] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1067.006425] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1067.006801] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.006933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.006999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.007272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.007456] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.007560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.007612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.007777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.007860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.007958] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.027511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.027772] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94e47e7e-ac8d-4d4a-ae5c-fb266118b21d is going to be deleted. [ 1067.029412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.029412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.054523] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.054648] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c60427c8-0bdd-4ef0-a14a-b6e54b6e072b is going to be deleted. [ 1067.055819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.056106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.096473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.096706] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f80555d1-ee88-4624-af40-5a9e62b1a6a6 is going to be deleted. [ 1067.098144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.098394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.111441] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.111540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.114467] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.114719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.122865] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1067.123152] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 1067.123236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.123385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.123763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.123973] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.124148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.124207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.124390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.127238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.127238] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.152913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.154617] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86c04db-ddf8-419d-8a90-125d10e637f6 is going to be deleted. [ 1067.155048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.155299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.259687] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: SUCCESS [ 1067.259920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.260095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.260716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.260806] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.260867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.260970] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.261124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.261233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.261351] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.292114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.292286] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 118c9912-ceb9-4aa1-bdf0-c6f83f3943b5 is going to be deleted. [ 1067.293536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.293846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.300079] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.300235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.301197] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.301334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.342049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.342194] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c7019e3-cf34-4117-9224-cf7758cc0cf6 is going to be deleted. [ 1067.343356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.343619] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.381189] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.381494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.381494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.381914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.382144] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.382271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.382343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.382557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.382650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.382742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.382919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.383236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.383304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.383746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.383746] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.383746] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.383906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.383937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.384219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.384491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.384554] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.395278] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.439202] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.439446] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.439527] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.439778] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.440088] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.440318] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.440381] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.440659] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.440824] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.441075] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.441253] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.441400] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.441536] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.441674] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.441788] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.441913] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.443952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.444070] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ed73c0e-357c-432a-a683-eda251f6d85a is going to be deleted. [ 1067.445827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.446338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.511028] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.511186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.522048] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.522220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.524321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.524423] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c96c798-8819-41b0-9168-410c415c2391 is going to be deleted. [ 1067.525901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.526185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.528640] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.528840] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.087 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1067.528986] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.529554] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.529745] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-79f1061f-98ac-49af-b817-9cc54af57f7f taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.529981] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-79f1061f-98ac-49af-b817-9cc54af57f7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.530131] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-79f1061f-98ac-49af-b817-9cc54af57f7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.530469] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-79f1061f-98ac-49af-b817-9cc54af57f7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.530625] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79f1061f-98ac-49af-b817-9cc54af57f7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.581312] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.581489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.614058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.614263] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69e29b7f-533c-4401-87fd-c37e43a88191 is going to be deleted. [ 1067.615718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.616171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.617864] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.617992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.621693] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.621837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.627612] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.662826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.663029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d71eb658-afb5-408d-a69d-dac4485c2f2e is going to be deleted. [ 1067.668415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.668690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.671000] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.671119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.748654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.748800] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d069dc70-d382-4790-b884-3c9bf5e88eb0 is going to be deleted. [ 1067.749922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.750218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.765136] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.832153] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.832153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.837021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.837021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a088526-39aa-4b85-a4b7-780ad374c69e is going to be deleted. [ 1067.837021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.837021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.868456] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.868456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.890968] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4ee4c50-7cd1-464f-8791-a617053e06f6: rpc.has_security_group_logging(os_id): False [ 1067.898832] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1246751-d3c4-4099-b16f-aa9fe0e1b1a6: rpc.has_security_group_logging(os_id): False [ 1067.951247] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.951247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.951247] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.951247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.964243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.964442] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 424e0166-59a6-441d-abf8-1fa9f2584819 is going to be deleted. [ 1067.965435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.965862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.967598] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.967698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.033614] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.033917] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.034112] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.034912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.034912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.035204] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 79f1061f-98ac-49af-b817-9cc54af57f7f not found, creating... [ 1068.036389] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.036389] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.036389] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.036389] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.036689] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.036928] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.037888] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.037888] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.037888] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.038148] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.038330] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 79f1061f-98ac-49af-b817-9cc54af57f7f is going to be created. [ 1068.041285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.041498] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be deleted. [ 1068.044426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.044809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.134779] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.141832] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.141987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.157556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.157786] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f345373-ada8-463f-8791-7b6fdbbaba03 is going to be deleted. [ 1068.159383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.159383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.159383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.159383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18b16119-4a62-4859-895e-b0f3732128ff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.159383] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.159632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.159632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.159864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94e47e7e-ac8d-4d4a-ae5c-fb266118b21d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.160310] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.160483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.160567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.160685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f80555d1-ee88-4624-af40-5a9e62b1a6a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.160820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.160962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.161608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.161608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c60427c8-0bdd-4ef0-a14a-b6e54b6e072b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.161608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.161608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.161608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.161818] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.161929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.161986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.162135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.162207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.162297] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be updated. [ 1068.163302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.163462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.164142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.164142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86c04db-ddf8-419d-8a90-125d10e637f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.164324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.164392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.164636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.164691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-118c9912-ceb9-4aa1-bdf0-c6f83f3943b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.165369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.165476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.165476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.165627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ed73c0e-357c-432a-a683-eda251f6d85a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.165751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.165886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.166012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.166203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c7019e3-cf34-4117-9224-cf7758cc0cf6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.166319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.166486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.166553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.166670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c96c798-8819-41b0-9168-410c415c2391" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.166797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.166936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.166999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.167128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69e29b7f-533c-4401-87fd-c37e43a88191" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.167252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.167390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.167483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.167641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d71eb658-afb5-408d-a69d-dac4485c2f2e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.167799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.168124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.170245] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.170485] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.170622] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.171548] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.171548] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.171548] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-79f1061f-98ac-49af-b817-9cc54af57f7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.174753] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.174943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.217061] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.217350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.218378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.218662] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.218762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.218813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.219023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.219121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.219293] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 1068.220625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.220863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.265971] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.296109] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.296526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.296723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.296987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.297159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.342428] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.342810] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.342937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.343030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.343247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.343332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.343555] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.343660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.343723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.343876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.343951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.344154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.344226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.344287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.344435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.344494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.344591] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 1068.345797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.345964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.346097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.346198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a088526-39aa-4b85-a4b7-780ad374c69e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.347432] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.347597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.347682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.347803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-424e0166-59a6-441d-abf8-1fa9f2584819" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.347962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.348220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.348298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.348411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.348530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.348670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.348744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.348847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d069dc70-d382-4790-b884-3c9bf5e88eb0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.367987] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.368287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.368406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.368720] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.368869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.369086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f345373-ada8-463f-8791-7b6fdbbaba03" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.370088] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1068.458031] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.458031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.458031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.458031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.458031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.484896] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 1068.548747] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.549130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.549130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.549345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.549539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.587622] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 1068.588468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.588810] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 1068.637893] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.638183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.638281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.638701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.638918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.639091] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1068.711421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.711646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.711691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.711986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.712217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.724983] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1068.761467] env[65553]: INFO networking_nsxv3.common.synchronization [req-19f5ef7b-ca86-4842-bd7d-09ebe9e75bb3 req-edb0b53a-5f81-45c3-86c4-da817698c672 service nova] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 1068.761467] env[65553]: INFO networking_nsxv3.common.synchronization [req-19f5ef7b-ca86-4842-bd7d-09ebe9e75bb3 req-edb0b53a-5f81-45c3-86c4-da817698c672 service nova] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1068.761467] env[65553]: INFO networking_nsxv3.common.synchronization [req-19f5ef7b-ca86-4842-bd7d-09ebe9e75bb3 req-edb0b53a-5f81-45c3-86c4-da817698c672 service nova] Enqueued Resource ID: 79f1061f-98ac-49af-b817-9cc54af57f7f with Priority: HIGHEST for action port [ 1068.762149] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 1068.762275] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1068.762315] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79f1061f-98ac-49af-b817-9cc54af57f7f with Priority: HIGHEST for action port [ 1068.762599] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.762776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.762864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.763351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.763351] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.764547] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.764678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.764848] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-79f1061f-98ac-49af-b817-9cc54af57f7f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.764955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79f1061f-98ac-49af-b817-9cc54af57f7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.765069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79f1061f-98ac-49af-b817-9cc54af57f7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.765266] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79f1061f-98ac-49af-b817-9cc54af57f7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.765333] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79f1061f-98ac-49af-b817-9cc54af57f7f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.769284] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.769423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.769500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.769704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.769886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.769886] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 is going to be updated. [ 1068.802539] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.802539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.802539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.802926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.802967] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.816507] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: IN_PROGRESS for 2s [ 1069.269847] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.269847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.272579] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79f1061f-98ac-49af-b817-9cc54af57f7f with status ACTIVE [ 1069.272579] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.272797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.272924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.273308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.273472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.273727] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.273907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.274059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.274328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.274701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.274701] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.274824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.274879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.275183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.275328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.275437] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79f1061f-98ac-49af-b817-9cc54af57f7f is going to be updated. [ 1069.335333] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.335735] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.335951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.336362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.336636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.336940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79f1061f-98ac-49af-b817-9cc54af57f7f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.383317] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1070.383789] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a deletion is rescheduled due to dependency. [ 1070.383789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.383789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.384170] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.384412] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.384577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.384666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.384908] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.385041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.385227] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.500566] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 1070.501145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.610413] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 1070.610748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.738863] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1070.739511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.739511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.739688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.739893] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.740076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.740076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.740244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.740343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.740454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.740548] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.829294] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: SUCCESS [ 1070.829411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.829599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.829836] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.830041] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.830166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.830234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.830392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.830474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.830558] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.830648] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.887506] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.243279] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.243279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.243508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.243858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.243858] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.243961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.243961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.244148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.244332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.244560] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.244755] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.244880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.244954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.245126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.245402] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.245520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.245586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.245736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.245817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.245919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.246101] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.333207] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.393677] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.748840] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9009da09-3880-4f06-b8cc-6f3ff62a7fbd: rpc.has_security_group_logging(os_id): False [ 1071.778591] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.778827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.778946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.779301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.779482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.780013] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.780129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.780166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.780428] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.780588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.780892] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.781666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.781821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.782115] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.782273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.782621] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.782808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.782940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.783208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.783392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.783548] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1071.836756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7: rpc.has_security_group_logging(os_id): False [ 1071.856853] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.857056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.857141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.857339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.879509] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.879750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.884280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.884635] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.884740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.884807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.885043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.885144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.885235] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 is going to be updated. [ 1071.886629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.886867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.887036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.897380] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.897628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.897726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.897968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.898077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.898259] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be updated. [ 1071.910831] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1071.932647] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.932853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.932898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.933135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.933297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.956882] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1071.979537] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.979714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.979714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.979925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.980096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.005517] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: IN_PROGRESS for 2s [ 1073.763180] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1073.763532] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1073.936075] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1073.936340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.936532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.936771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.936882] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.969634] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1073.969927] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.970145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.970434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.970668] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.970793] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.970856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.971042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.971111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.971202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.971296] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.021937] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: SUCCESS [ 1074.022265] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.439606] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.442556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.442556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.442556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.442556] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.442556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.442556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.442556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.442556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.442556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.442556] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.476688] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.949163] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.949163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.949535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.949535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.949771] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.949907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.949993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.950234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.950380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.950506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.950725] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.950856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.950943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.951176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.951393] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.951527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.951635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.951882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.951999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.952163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.952304] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.978820] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 015f5088-3b94-432c-9304-6fd98b4fe26a: rpc.has_security_group_logging(os_id): False [ 1075.000468] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.001182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.001182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.001182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.001182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.001447] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.001643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.001766] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.001988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.002127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.002292] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be created. [ 1075.079128] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.079335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.079335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.079552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.079800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.099010] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1075.455353] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9009da09-3880-4f06-b8cc-6f3ff62a7fbd: rpc.has_security_group_logging(os_id): False [ 1075.475019] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.475184] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.475227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.475461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.475556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.475816] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.475925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.475990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.476318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.476410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.476587] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.476707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.476777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.476919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.477023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.477245] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.477342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.477408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.477592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.477674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.477778] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1075.549870] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.550134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.550134] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.550328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.550599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.568282] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1075.721183] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.721453] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.721627] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.722008] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.722443] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.722608] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.722913] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.722979] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.723084] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.723293] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.723395] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.723501] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.723603] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.723707] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.723823] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.723953] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.746280] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.746280] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1075.746280] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.746435] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-706" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.746680] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-72852e57-090e-47b1-8fa1-e6f92f7c6382 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.746863] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.746982] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.747263] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.747423] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72852e57-090e-47b1-8fa1-e6f92f7c6382',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.250719] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.251062] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.251188] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.251471] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.251621] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.251923] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.252135] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.252298] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.252456] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.252591] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.252886] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.253058] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.253156] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.253359] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.253492] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.253631] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 72852e57-090e-47b1-8fa1-e6f92f7c6382 is going to be updated. [ 1076.276070] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.276336] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.276497] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.276942] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.277273] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.277604] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.994619] env[65553]: INFO networking_nsxv3.common.synchronization [req-af00c870-bb93-4b5a-ba2e-8cece12ed1f5 req-89042339-5e29-4b40-b09c-cd2d935265b8 service nova] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_rules [ 1076.994842] env[65553]: INFO networking_nsxv3.common.synchronization [req-af00c870-bb93-4b5a-ba2e-8cece12ed1f5 req-89042339-5e29-4b40-b09c-cd2d935265b8 service nova] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 1076.994963] env[65553]: INFO networking_nsxv3.common.synchronization [req-af00c870-bb93-4b5a-ba2e-8cece12ed1f5 req-89042339-5e29-4b40-b09c-cd2d935265b8 service nova] Enqueued Resource ID: 72852e57-090e-47b1-8fa1-e6f92f7c6382 with Priority: HIGHEST for action port [ 1076.996792] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_rules [ 1076.996792] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 1076.996792] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72852e57-090e-47b1-8fa1-e6f92f7c6382 with Priority: HIGHEST for action port [ 1076.996792] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.997084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.997084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.997575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.998171] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.000949] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.000949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.000949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.000949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.000949] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.000949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.000949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.002445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.002573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.002717] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.003727] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-72852e57-090e-47b1-8fa1-e6f92f7c6382 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.003907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.004061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.004322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.004499] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72852e57-090e-47b1-8fa1-e6f92f7c6382',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.119353] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1077.122492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.506029] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.507296] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.507403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.507788] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72852e57-090e-47b1-8fa1-e6f92f7c6382 with status ACTIVE [ 1077.507961] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.508076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.508137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.508417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.508513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.508660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.508777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.508820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.508957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.509044] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.509225] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.509353] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.509422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.509537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.509592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.509679] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72852e57-090e-47b1-8fa1-e6f92f7c6382 is going to be updated. [ 1077.534505] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.534812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.534812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.535039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.535139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.535309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72852e57-090e-47b1-8fa1-e6f92f7c6382" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.589153] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1077.589416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.008392] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.510620] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.511023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.511023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.511227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.511442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.511569] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 1078.545366] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.545630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.545630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.545776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.545938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.556787] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 1079.882471] env[65553]: INFO networking_nsxv3.common.synchronization [req-4b6cb1e5-39df-4cc6-b108-d4eea515dde1 req-358ac0f2-eb9f-4c3c-b0ad-a8c0e32091a9 tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1079.883358] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1079.883610] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.883779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.883878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.884169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.884392] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.884539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.884631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.884878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.885034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.885305] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.387990] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.388201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.388254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.388533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.388629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.388832] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.388921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.388983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.389153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.389228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.389314] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 1080.421799] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.422022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.422022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.422260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.422398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.434099] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 1080.570538] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 1080.570904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.571166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.571524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.571826] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.572012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.572122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.572360] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.572488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.572622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.572762] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.075816] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.076237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.076237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.076454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.076725] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.076863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.076984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.077659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.077659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.077659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.077794] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.077879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.077949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.078189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.078421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.078602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.078602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.078731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.078787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.078860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.078949] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.581242] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4ee4c50-7cd1-464f-8791-a617053e06f6: rpc.has_security_group_logging(os_id): False [ 1081.600589] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.600926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.600926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.601247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.601393] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.601675] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.601835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.601951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.602196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.602326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.602583] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.602738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.602935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.603169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.603301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.603567] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.603745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.603843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.604052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.604171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.604284] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 1081.709273] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.709556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.709556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.709754] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.709922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.786056] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 1082.449038] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 1082.449408] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 deletion is rescheduled due to dependency. [ 1082.449481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.805905] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 1083.806290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.884616] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1084.884908] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1089.763932] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-799 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.764385] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.764385] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.764865] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.765302] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.765497] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.765632] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.765897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.766101] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.766359] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.766474] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.766616] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.766724] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.766857] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.766977] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.767153] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.789993] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.790189] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.790313] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.790480] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-799" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.790805] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-5271e9dd-24bd-4c91-a30d-2085e7809b02 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.790976] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.791102] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.791369] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.791503] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5271e9dd-24bd-4c91-a30d-2085e7809b02',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.874326] env[65553]: INFO networking_nsxv3.common.synchronization [None req-29cfbab8-61c1-4048-975d-ec9b382b352c None None] Enqueued Resource ID: 7eec39c6-a68b-4d38-9096-2c49b9e7bb0d with Priority: HIGHEST for action port [ 1089.874846] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eec39c6-a68b-4d38-9096-2c49b9e7bb0d with Priority: HIGHEST for action port [ 1089.879424] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eec39c6-a68b-4d38-9096-2c49b9e7bb0d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.879609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eec39c6-a68b-4d38-9096-2c49b9e7bb0d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.879706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eec39c6-a68b-4d38-9096-2c49b9e7bb0d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.880029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eec39c6-a68b-4d38-9096-2c49b9e7bb0d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.880151] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eec39c6-a68b-4d38-9096-2c49b9e7bb0d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.295151] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.295151] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.295356] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.295649] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.295869] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.296345] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.296508] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.296640] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.296877] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.297026] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.297356] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.297519] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.297650] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.297862] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.298031] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.298178] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 5271e9dd-24bd-4c91-a30d-2085e7809b02 is going to be updated. [ 1090.322538] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.322827] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.322998] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.323364] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.323592] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.323885] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.385631] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7eec39c6-a68b-4d38-9096-2c49b9e7bb0d [ 1090.385631] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.385631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.385631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.385631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.385631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.385631] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7eec39c6-a68b-4d38-9096-2c49b9e7bb0d already deleted. [ 1090.385631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eec39c6-a68b-4d38-9096-2c49b9e7bb0d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.046145] env[65553]: INFO networking_nsxv3.common.synchronization [req-01e7d032-9d41-4e9a-b48e-e412aa0dce6c req-c6ed93b9-0d8b-4b91-8ae2-40f35c140aa3 service nova] Enqueued Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_rules [ 1091.046145] env[65553]: INFO networking_nsxv3.common.synchronization [req-01e7d032-9d41-4e9a-b48e-e412aa0dce6c req-c6ed93b9-0d8b-4b91-8ae2-40f35c140aa3 service nova] Enqueued Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 1091.046510] env[65553]: INFO networking_nsxv3.common.synchronization [req-01e7d032-9d41-4e9a-b48e-e412aa0dce6c req-c6ed93b9-0d8b-4b91-8ae2-40f35c140aa3 service nova] Enqueued Resource ID: 5271e9dd-24bd-4c91-a30d-2085e7809b02 with Priority: HIGHEST for action port [ 1091.046876] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_rules [ 1091.047910] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 1091.047910] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5271e9dd-24bd-4c91-a30d-2085e7809b02 with Priority: HIGHEST for action port [ 1091.047910] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.047910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.047910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.047910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.047910] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.049177] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.049287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.049358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.049589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.049764] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.049868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.049923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.050094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.050175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.050267] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.051109] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-5271e9dd-24bd-4c91-a30d-2085e7809b02 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.051240] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.051271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.052519] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.052684] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5271e9dd-24bd-4c91-a30d-2085e7809b02',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.483663] env[65553]: INFO networking_nsxv3.common.synchronization [req-75da78ce-27c6-4359-ba4e-9ac51c483368 req-53e938ef-9c51-4714-93fe-6c88bc943b24 tempest-AttachVolumeShelveTestJSON-653256025 tempest-AttachVolumeShelveTestJSON-653256025-project-member] Enqueued Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_members [ 1091.484398] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ef9829-ef49-436a-a11a-bae751628c4a with Priority: HIGHEST for action security_group_members [ 1091.484748] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2ef9829-ef49-436a-a11a-bae751628c4a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.485786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.485786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.485988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.486052] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.486137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.486203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.486361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.486530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.486584] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2ef9829-ef49-436a-a11a-bae751628c4a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.554490] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.555770] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.555894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.556265] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5271e9dd-24bd-4c91-a30d-2085e7809b02 with status ACTIVE [ 1091.556434] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.556551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.556617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.556822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.556904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.557088] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.557181] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.557243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.557389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.557488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.557717] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.557819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.557868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.558014] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.558804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.558941] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5271e9dd-24bd-4c91-a30d-2085e7809b02 is going to be updated. [ 1091.582988] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.583159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.583212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.583425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.583584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.583816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5271e9dd-24bd-4c91-a30d-2085e7809b02" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.989436] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.989628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.989713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.989936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.012772] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.013107] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.013180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.013403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.013484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.013484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.013573] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2ef9829-ef49-436a-a11a-bae751628c4a is going to be updated. [ 1092.043107] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.043322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.043322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.043656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.043802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.053641] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2ef9829-ef49-436a-a11a-bae751628c4a in Status: IN_PROGRESS for 2s [ 1092.057121] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.561045] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.561045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.561045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.561045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.561045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.561045] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f is going to be updated. [ 1092.596980] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.597161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.597234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.597445] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.597589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.608117] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: IN_PROGRESS for 2s [ 1093.139769] env[65553]: INFO networking_nsxv3.common.synchronization [req-751cf07c-3c88-46c3-94ec-7a89e4cb807a req-abcb89ce-2be7-4a6d-8e68-c81bbea04aa8 tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1093.140324] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1093.141180] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.141180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.141180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.141180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.141386] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.141896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.141896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.142087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.142196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.142792] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.538125] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.538125] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.538394] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.538589] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.539347] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.539347] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.539347] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.539662] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.539662] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.539883] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.540093] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.540160] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.540324] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.540549] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.540878] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.541057] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.565535] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.565782] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1093.565924] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.566133] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.566488] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-2cd742df-3487-409f-ad0d-1b1c2510c171 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.566718] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-2cd742df-3487-409f-ad0d-1b1c2510c171" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.566937] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-2cd742df-3487-409f-ad0d-1b1c2510c171" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.567417] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-2cd742df-3487-409f-ad0d-1b1c2510c171" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.567659] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cd742df-3487-409f-ad0d-1b1c2510c171',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.646104] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.646265] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.646345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.646576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.646673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.646895] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.647145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.647145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.647248] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.647305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.647371] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 1093.677947] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.678111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.678176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.678410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.678640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.688599] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 1094.064849] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2ef9829-ef49-436a-a11a-bae751628c4a in Status: SUCCESS [ 1094.065059] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2ef9829-ef49-436a-a11a-bae751628c4a deletion is rescheduled due to dependency. [ 1094.065157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2ef9829-ef49-436a-a11a-bae751628c4a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.070857] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.071120] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.071242] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.071516] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.071705] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.071924] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 2cd742df-3487-409f-ad0d-1b1c2510c171 not found, creating... [ 1094.072205] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.072376] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.072521] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.072703] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.072909] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.073123] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.073280] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.073396] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.073607] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.073744] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.073886] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 2cd742df-3487-409f-ad0d-1b1c2510c171 is going to be created. [ 1094.099158] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.099158] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.099158] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.099441] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.099641] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.099882] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-2cd742df-3487-409f-ad0d-1b1c2510c171" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.157445] env[65553]: INFO networking_nsxv3.common.synchronization [None req-12bac05b-b4b5-46ea-b911-26761c0c26c5 None None] Enqueued Resource ID: 0ad6323f-bb0d-487a-beeb-941846a72893 with Priority: HIGHEST for action port [ 1094.158741] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad6323f-bb0d-487a-beeb-941846a72893 with Priority: HIGHEST for action port [ 1094.159210] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ad6323f-bb0d-487a-beeb-941846a72893 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.159466] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ad6323f-bb0d-487a-beeb-941846a72893" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.159716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ad6323f-bb0d-487a-beeb-941846a72893" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.160106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ad6323f-bb0d-487a-beeb-941846a72893" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.160282] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ad6323f-bb0d-487a-beeb-941846a72893',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.618919] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: SUCCESS [ 1094.619155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.619319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.619555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.619753] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.619874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.619939] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.620100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.620182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.620269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.620352] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.663140] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ad6323f-bb0d-487a-beeb-941846a72893 [ 1094.663397] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.663532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.663618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.663834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.663935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.664047] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ad6323f-bb0d-487a-beeb-941846a72893 already deleted. [ 1094.664138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ad6323f-bb0d-487a-beeb-941846a72893" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.914333] env[65553]: INFO networking_nsxv3.common.synchronization [req-751cf07c-3c88-46c3-94ec-7a89e4cb807a req-20f5b946-fc88-4cfc-9bfc-7ab0bfce578d service nova] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_rules [ 1094.914333] env[65553]: INFO networking_nsxv3.common.synchronization [req-751cf07c-3c88-46c3-94ec-7a89e4cb807a req-20f5b946-fc88-4cfc-9bfc-7ab0bfce578d service nova] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1094.914333] env[65553]: INFO networking_nsxv3.common.synchronization [req-751cf07c-3c88-46c3-94ec-7a89e4cb807a req-20f5b946-fc88-4cfc-9bfc-7ab0bfce578d service nova] Enqueued Resource ID: 2cd742df-3487-409f-ad0d-1b1c2510c171 with Priority: HIGHEST for action port [ 1094.914612] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_rules [ 1094.914725] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1094.914834] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cd742df-3487-409f-ad0d-1b1c2510c171 with Priority: HIGHEST for action port [ 1094.915173] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.915381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.915434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.915629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.915828] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.918780] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.918780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.918780] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cd742df-3487-409f-ad0d-1b1c2510c171 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.918780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cd742df-3487-409f-ad0d-1b1c2510c171" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.918780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cd742df-3487-409f-ad0d-1b1c2510c171" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.918780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cd742df-3487-409f-ad0d-1b1c2510c171" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.918780] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cd742df-3487-409f-ad0d-1b1c2510c171',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.123025] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.123231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.123300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.123788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.124074] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.124236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.124345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.124540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.124635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.124727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.124878] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.125090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.125157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.125305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.125447] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.125540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.125601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.125735] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.125808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.125887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.125973] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.215175] env[65553]: INFO networking_nsxv3.common.synchronization [None req-50906b39-51cb-4f75-9f7f-a121fa70c42d None None] Enqueued Resource ID: 3dadbdb1-a88e-4321-b4d9-ed3e4027d005 with Priority: HIGHEST for action port [ 1095.215175] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dadbdb1-a88e-4321-b4d9-ed3e4027d005 with Priority: HIGHEST for action port [ 1095.215175] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dadbdb1-a88e-4321-b4d9-ed3e4027d005 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.215530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dadbdb1-a88e-4321-b4d9-ed3e4027d005" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.215530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dadbdb1-a88e-4321-b4d9-ed3e4027d005" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.215530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dadbdb1-a88e-4321-b4d9-ed3e4027d005" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.215647] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dadbdb1-a88e-4321-b4d9-ed3e4027d005',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.420151] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.420151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.421290] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cd742df-3487-409f-ad0d-1b1c2510c171 with status ACTIVE [ 1095.422576] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.422576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.422576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.422706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.422833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.423083] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.424080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.424080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.424080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.424080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.424080] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.424080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.424080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.424080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.424080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.424458] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cd742df-3487-409f-ad0d-1b1c2510c171 is going to be updated. [ 1095.449589] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.449589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.449589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.449909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.450124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.450349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cd742df-3487-409f-ad0d-1b1c2510c171" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.631527] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d5d7b40-1056-43d4-a9d4-099288f67f0f: rpc.has_security_group_logging(os_id): False [ 1095.653116] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.653116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.653116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.653116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.675141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.677570] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.677760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.677760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.677997] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.678121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.678385] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.678559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.678631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.681023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.681023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.681023] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.681023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.681023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.681023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.681023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.681023] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f is going to be updated. [ 1095.703335] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 1095.703335] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 deletion is rescheduled due to dependency. [ 1095.703335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.703536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.705276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.705276] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.705276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.705276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.705276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.705276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.705276] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.719451] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3dadbdb1-a88e-4321-b4d9-ed3e4027d005 [ 1095.719718] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.719850] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.719918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.720148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.720232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.720326] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3dadbdb1-a88e-4321-b4d9-ed3e4027d005 already deleted. [ 1095.720397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dadbdb1-a88e-4321-b4d9-ed3e4027d005" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.750531] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.750660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.750734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.752035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.752417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.771853] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: IN_PROGRESS for 2s [ 1096.115566] env[65553]: INFO networking_nsxv3.common.synchronization [req-25913adb-0b6d-4c4f-8208-b875d354b1dd req-e0270f15-8394-4f3c-bd97-8515c20e0a55 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1096.115566] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1096.117971] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.117971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.117971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.117971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.117971] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.117971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.117971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.117971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.117971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.117971] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.211426] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.621827] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.715499] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.039505] env[65553]: INFO networking_nsxv3.common.synchronization [None req-cbc41070-cd62-4b89-9f1c-87b990138f88 None None] Enqueued Resource ID: 9b0b4a22-4d79-425c-a347-a6be025ba951 with Priority: HIGHEST for action port [ 1097.040076] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b0b4a22-4d79-425c-a347-a6be025ba951 with Priority: HIGHEST for action port [ 1097.040386] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b0b4a22-4d79-425c-a347-a6be025ba951 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.040536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b0b4a22-4d79-425c-a347-a6be025ba951" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.040593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b0b4a22-4d79-425c-a347-a6be025ba951" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.041288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b0b4a22-4d79-425c-a347-a6be025ba951" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.041288] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b0b4a22-4d79-425c-a347-a6be025ba951',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.067051] env[65553]: INFO networking_nsxv3.common.synchronization [None req-f32ec6d5-5609-49ae-aa56-19f96606bab2 tempest-AttachVolumeShelveTestJSON-653256025 tempest-AttachVolumeShelveTestJSON-653256025-project-member] Enqueued Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_rules [ 1097.067591] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_rules [ 1097.067937] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.068080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.068139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.068378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.068459] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.130228] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.169128] env[65553]: INFO networking_nsxv3.common.synchronization [None req-bf7d6765-4e3f-4e89-ac08-911797fc9ec7 tempest-AttachVolumeShelveTestJSON-653256025 tempest-AttachVolumeShelveTestJSON-653256025-project-member] Enqueued Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_rules [ 1097.169621] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_rules [ 1097.170680] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.170680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.217966] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.217966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.218218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.218867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.218867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.218867] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 1097.255171] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.255411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.255496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.255946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.256109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.266937] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 1097.543977] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b0b4a22-4d79-425c-a347-a6be025ba951 [ 1097.544116] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.544471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.544471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.544579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.544579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.544817] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b0b4a22-4d79-425c-a347-a6be025ba951 already deleted. [ 1097.544817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b0b4a22-4d79-425c-a347-a6be025ba951" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.596045] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.596224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.596295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.596503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.596627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.596756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 already deleted. [ 1097.596756] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.596942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.598038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.598038] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.631124] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.631650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.631803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.632110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.632286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.632511] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f is going to be updated. [ 1097.668585] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.668726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.669090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.669090] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.669167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.679932] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: IN_PROGRESS for 2s [ 1097.790825] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: SUCCESS [ 1097.791132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.119893] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.119893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.119893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.119893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.119893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.119893] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 already deleted. [ 1098.120623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.435824] env[65553]: INFO networking_nsxv3.common.synchronization [req-86a9327c-5789-486d-82b9-9de16010bf99 req-371f58de-c054-49c3-9679-9e3772467e97 tempest-ServersNegativeTestMultiTenantJSON-687762692 tempest-ServersNegativeTestMultiTenantJSON-687762692-project-member] Enqueued Resource ID: 8d626d81-6003-4f84-b690-4708f139d600 with Priority: HIGHEST for action security_group_members [ 1098.436419] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d626d81-6003-4f84-b690-4708f139d600 with Priority: HIGHEST for action security_group_members [ 1098.436859] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d626d81-6003-4f84-b690-4708f139d600 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.436975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.437056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.437450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.437620] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.437728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.437787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.437948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.438046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.438142] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d626d81-6003-4f84-b690-4708f139d600',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.916960] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-217 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.919037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-217" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.919037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-217" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.919037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-217" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.919037] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.919037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.919037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.919037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.919481] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.919901] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.919901] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.919901] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.920077] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.920231] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.920331] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.920522] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.941368] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.941590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.941669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.941885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.941974] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.942225] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.942378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.942456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.942636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.942747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.942853] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d626d81-6003-4f84-b690-4708f139d600 already deleted. [ 1098.942966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.947609] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.947790] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1098.947938] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.948405] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-217" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.948625] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-0603ba3b-ac7a-46b6-b6ba-4cbc469022f2 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.948830] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-0603ba3b-ac7a-46b6-b6ba-4cbc469022f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.948951] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-0603ba3b-ac7a-46b6-b6ba-4cbc469022f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.949306] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-0603ba3b-ac7a-46b6-b6ba-4cbc469022f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.949495] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0603ba3b-ac7a-46b6-b6ba-4cbc469022f2',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.279800] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 1099.279800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.279800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.280093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.280130] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.280262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.280330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.280500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.280580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.280668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.280762] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.454906] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.454906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.454906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.454906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.454906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.454906] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 0603ba3b-ac7a-46b6-b6ba-4cbc469022f2 not found, creating... [ 1099.454906] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.454906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.454906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.454906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.454906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.455556] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.455556] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.455703] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.455928] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.456078] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.456311] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 0603ba3b-ac7a-46b6-b6ba-4cbc469022f2 is going to be created. [ 1099.484884] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.484884] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.484884] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.484884] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.484884] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.484884] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-0603ba3b-ac7a-46b6-b6ba-4cbc469022f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.695154] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: SUCCESS [ 1099.695489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.783434] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.232886] env[65553]: INFO networking_nsxv3.common.synchronization [req-86a9327c-5789-486d-82b9-9de16010bf99 req-af2ea4bf-6f96-41e6-964e-a565f18abd47 service nova] Enqueued Resource ID: 8d626d81-6003-4f84-b690-4708f139d600 with Priority: HIGHEST for action security_group_rules [ 1100.233392] env[65553]: INFO networking_nsxv3.common.synchronization [req-86a9327c-5789-486d-82b9-9de16010bf99 req-af2ea4bf-6f96-41e6-964e-a565f18abd47 service nova] Enqueued Resource ID: 8d626d81-6003-4f84-b690-4708f139d600 with Priority: HIGHEST for action security_group_members [ 1100.233392] env[65553]: INFO networking_nsxv3.common.synchronization [req-86a9327c-5789-486d-82b9-9de16010bf99 req-af2ea4bf-6f96-41e6-964e-a565f18abd47 service nova] Enqueued Resource ID: 0603ba3b-ac7a-46b6-b6ba-4cbc469022f2 with Priority: HIGHEST for action port [ 1100.233855] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d626d81-6003-4f84-b690-4708f139d600 with Priority: HIGHEST for action security_group_rules [ 1100.234000] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d626d81-6003-4f84-b690-4708f139d600 with Priority: HIGHEST for action security_group_members [ 1100.236121] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0603ba3b-ac7a-46b6-b6ba-4cbc469022f2 with Priority: HIGHEST for action port [ 1100.236508] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d626d81-6003-4f84-b690-4708f139d600 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.236677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.236786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.237089] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.237413] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d626d81-6003-4f84-b690-4708f139d600',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.239266] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d626d81-6003-4f84-b690-4708f139d600 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.239427] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.239499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.239700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.241489] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.241489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.241489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.241489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.241489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.241489] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d626d81-6003-4f84-b690-4708f139d600',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.241857] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-0603ba3b-ac7a-46b6-b6ba-4cbc469022f2 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.241857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0603ba3b-ac7a-46b6-b6ba-4cbc469022f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.241857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0603ba3b-ac7a-46b6-b6ba-4cbc469022f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.242025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0603ba3b-ac7a-46b6-b6ba-4cbc469022f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.242170] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0603ba3b-ac7a-46b6-b6ba-4cbc469022f2',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.290028] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1246751-d3c4-4099-b16f-aa9fe0e1b1a6: rpc.has_security_group_logging(os_id): False [ 1100.314616] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.314837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.314876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.315189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.315378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.315682] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.315819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.315905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.316106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.316220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.316336] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 1100.384758] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.384989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.384989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.385237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.385387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.413888] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 1100.746157] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d626d81-6003-4f84-b690-4708f139d600',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.747360] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d626d81-6003-4f84-b690-4708f139d600 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.747749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.748013] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0603ba3b-ac7a-46b6-b6ba-4cbc469022f2 with status ACTIVE [ 1100.748283] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.748454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.748613] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.748842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.748959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.749171] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.749307] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.749373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.749569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.749653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.749872] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.750013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.750061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.750232] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.750305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.750408] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0603ba3b-ac7a-46b6-b6ba-4cbc469022f2 is going to be updated. [ 1100.775592] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.775753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.775811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.776062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.776161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.776441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0603ba3b-ac7a-46b6-b6ba-4cbc469022f2" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.252924] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d626d81-6003-4f84-b690-4708f139d600',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.756065] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.756285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.756442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.756649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.756743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.756863] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d626d81-6003-4f84-b690-4708f139d600 is going to be created. [ 1101.785022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.785288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.786377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.786377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.786377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.802717] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d626d81-6003-4f84-b690-4708f139d600 in Status: UNINITIALIZED for 2s [ 1102.438083] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 1102.438456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.989978] env[65553]: INFO networking_nsxv3.common.synchronization [req-a702ffb2-090f-4540-9231-2ad2e5f059bb req-d483091c-f305-4a05-863b-495cc07095c9 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_members [ 1102.990820] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0381d463-a205-4270-82ca-0eb7d56637ee with Priority: HIGHEST for action security_group_members [ 1102.991352] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-0381d463-a205-4270-82ca-0eb7d56637ee taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.991616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.991616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.991911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.992061] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.992229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.992331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.992583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.992691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.992867] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0381d463-a205-4270-82ca-0eb7d56637ee',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.442595] env[65553]: INFO networking_nsxv3.common.synchronization [req-612216ab-d2ea-4b9f-8866-197698bca3b8 req-811602b5-d8b7-4513-a818-80af98b61756 tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1103.443968] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1103.443968] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.443968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.443968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.443968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.444223] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.444223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.444288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.444421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.444500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.444590] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.495599] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.495804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.495840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.497062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.521730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.521992] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.522130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.522198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.522409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.522481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.522572] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0381d463-a205-4270-82ca-0eb7d56637ee is going to be updated. [ 1103.558668] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.558668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.558668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.558668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.558668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.571997] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0381d463-a205-4270-82ca-0eb7d56637ee in Status: IN_PROGRESS for 2s [ 1103.818434] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d626d81-6003-4f84-b690-4708f139d600 in Status: SUCCESS [ 1103.818434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.818434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.818434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.818434] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.818434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.818434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.818434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.818434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.818434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.818434] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d626d81-6003-4f84-b690-4708f139d600',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.946610] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.947366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.947366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.947566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.947692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.947914] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.948036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.948103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.948271] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.948364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.948492] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1103.981905] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.982098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.982167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.982346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.982503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.996938] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1104.322215] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d626d81-6003-4f84-b690-4708f139d600 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.322328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.322415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.322942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.322942] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.323066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.323105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.323318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.323411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.323507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.323749] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d626d81-6003-4f84-b690-4708f139d600 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.323859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.323947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.324146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.324315] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.324431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.324505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.324657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.324742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.324864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.324990] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d626d81-6003-4f84-b690-4708f139d600',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.827792] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d626d81-6003-4f84-b690-4708f139d600: rpc.has_security_group_logging(os_id): False [ 1104.848147] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.848447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.848531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.848923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.849087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.849417] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.849695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.849886] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.850133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.850226] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.850479] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.850589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.850656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.850842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.850925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.851949] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.851949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.851949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.851949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.851949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.851949] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d626d81-6003-4f84-b690-4708f139d600 is going to be created. [ 1104.917794] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.917980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.918070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.918287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.918469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.930371] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d626d81-6003-4f84-b690-4708f139d600 in Status: IN_PROGRESS for 2s [ 1105.301958] env[65553]: INFO networking_nsxv3.common.synchronization [req-8c521240-14a5-48d4-b32b-570c203282ad req-988ea6b3-7bd8-4b40-9c4a-7f45dfc61b45 tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1105.302733] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f with Priority: HIGHEST for action security_group_members [ 1105.303244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.303365] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.303458] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.303641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.303936] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.304058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.304123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.304297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.304386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.304491] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('066e3ae9-ef84-454d-bd16-ad65fcc46e8f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.524605] env[65553]: INFO networking_nsxv3.common.synchronization [req-7a582d55-4717-488d-b8fa-374b4b7f7a4b req-25f6545c-9b2c-48ab-8118-259b1b65af63 tempest-AttachVolumeShelveTestJSON-653256025 tempest-AttachVolumeShelveTestJSON-653256025-project-member] Enqueued Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_members [ 1105.525185] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_members [ 1105.525557] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.525694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.525694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.525980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.526701] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.526987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.526987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.527212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.527212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.527212] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.583833] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0381d463-a205-4270-82ca-0eb7d56637ee in Status: SUCCESS [ 1105.584065] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0381d463-a205-4270-82ca-0eb7d56637ee deletion is rescheduled due to dependency. [ 1105.584228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0381d463-a205-4270-82ca-0eb7d56637ee" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.650275] env[65553]: INFO networking_nsxv3.common.synchronization [req-efbc76c6-c132-4c2e-8357-66a4487fd55a req-1457451e-4eea-403e-a8fb-ae245b373364 tempest-ServersTestJSON-941555489 tempest-ServersTestJSON-941555489-project-member] Enqueued Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_members [ 1105.651182] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87be6074-60bc-4100-998c-628cc41a4590 with Priority: HIGHEST for action security_group_members [ 1105.651804] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-87be6074-60bc-4100-998c-628cc41a4590 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.651980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.651980] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.652940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.652940] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.652940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.652940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.652940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.653253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.653253] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('87be6074-60bc-4100-998c-628cc41a4590',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.810451] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.810597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.810702] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.810883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.835175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.835444] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.835558] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.835621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.835817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.835901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.835990] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f is going to be updated. [ 1105.865658] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.865999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.866126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.866402] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.866581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.878021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: IN_PROGRESS for 2s [ 1105.982575] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.982575] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.982575] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.983088] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.983155] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.983916] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.983916] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.983916] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.984073] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.984291] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.984395] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.984507] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.984598] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.985130] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.985130] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.985130] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.004684] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.004784] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1106.005057] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.005161] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.005488] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-7b451c2f-954a-4a8a-8fc5-f2815d21999d taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.005664] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.005942] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.006125] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.006260] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b451c2f-954a-4a8a-8fc5-f2815d21999d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.009463] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1106.010067] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 1106.010175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.029342] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.029482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.029543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.029834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.029936] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.030590] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.030590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.030590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.030590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.030590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.030590] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 already deleted. [ 1106.031126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.156054] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.156054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.156054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.156054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.178416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.178709] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.178832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.178923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.179148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.179228] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.179327] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87be6074-60bc-4100-998c-628cc41a4590 is going to be updated. [ 1106.208203] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.208345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.208416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.208618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.208832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.221143] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87be6074-60bc-4100-998c-628cc41a4590 in Status: IN_PROGRESS for 2s [ 1106.509821] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.509821] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.509821] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.509821] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.509821] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.509821] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 7b451c2f-954a-4a8a-8fc5-f2815d21999d not found, creating... [ 1106.510693] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.510790] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.510868] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.511144] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.511307] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.511609] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.511777] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.513783] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.514114] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.514226] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.514379] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 7b451c2f-954a-4a8a-8fc5-f2815d21999d is going to be created. [ 1106.539682] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.539682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.539682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.539682] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.539978] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.541449] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.943973] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d626d81-6003-4f84-b690-4708f139d600 in Status: SUCCESS [ 1106.944343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.276199] env[65553]: INFO networking_nsxv3.common.synchronization [req-7a582d55-4717-488d-b8fa-374b4b7f7a4b req-ff4f7351-cf96-4480-85e5-3d488b95da89 service nova] Enqueued Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_rules [ 1107.276199] env[65553]: INFO networking_nsxv3.common.synchronization [req-7a582d55-4717-488d-b8fa-374b4b7f7a4b req-ff4f7351-cf96-4480-85e5-3d488b95da89 service nova] Enqueued Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_members [ 1107.276199] env[65553]: INFO networking_nsxv3.common.synchronization [req-7a582d55-4717-488d-b8fa-374b4b7f7a4b req-ff4f7351-cf96-4480-85e5-3d488b95da89 service nova] Enqueued Resource ID: 7b451c2f-954a-4a8a-8fc5-f2815d21999d with Priority: HIGHEST for action port [ 1107.276692] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_rules [ 1107.276845] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_members [ 1107.276909] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b451c2f-954a-4a8a-8fc5-f2815d21999d with Priority: HIGHEST for action port [ 1107.277186] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.277329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.277374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.277609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.277653] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.278470] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.278862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.278862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.278924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.279039] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.279161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.279208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.279333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.279427] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.279525] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.281528] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b451c2f-954a-4a8a-8fc5-f2815d21999d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.281701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.281701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.282561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.282561] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b451c2f-954a-4a8a-8fc5-f2815d21999d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.787357] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.787672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.787672] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.788631] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b451c2f-954a-4a8a-8fc5-f2815d21999d with status ACTIVE [ 1107.788884] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.789073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.789073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.789279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.789391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.789585] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.789719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.789797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.789961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.794076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.794199] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.794315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.794393] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.798024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.798024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.798024] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b451c2f-954a-4a8a-8fc5-f2815d21999d is going to be updated. [ 1107.824818] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.824990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.825114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.825726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.825726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.825889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.890421] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f in Status: SUCCESS [ 1107.890607] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 066e3ae9-ef84-454d-bd16-ad65fcc46e8f deletion is rescheduled due to dependency. [ 1107.890607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-066e3ae9-ef84-454d-bd16-ad65fcc46e8f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.233047] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 87be6074-60bc-4100-998c-628cc41a4590 in Status: SUCCESS [ 1108.233326] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 87be6074-60bc-4100-998c-628cc41a4590 deletion is rescheduled due to dependency. [ 1108.233460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-87be6074-60bc-4100-998c-628cc41a4590" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.297914] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.800698] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.800698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.800698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.800698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.800698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.800698] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 is going to be created. [ 1108.829525] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.829810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.829946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.830311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.830612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.842658] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 in Status: UNINITIALIZED for 2s [ 1110.071544] env[65553]: INFO networking_nsxv3.common.synchronization [req-9a043d06-5b79-45b5-a35c-02644d500dd8 req-36324bf7-3452-496f-9d51-11704656e149 tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1110.072484] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1110.073045] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.074497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.074497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.074497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.074497] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.074497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.074497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.074497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.074497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.074497] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.255317] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d501e311-ba60-4543-8807-1274e4de6d64 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_rules [ 1110.256361] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_rules [ 1110.256752] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d61543-0c85-4845-bdc5-d666ed96b205 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.256889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.256956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.258072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.258072] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.377351] env[65553]: INFO networking_nsxv3.common.synchronization [None req-e84a3487-60e0-45f3-ad61-4664f12d57ab tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_rules [ 1110.377351] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_rules [ 1110.377351] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d61543-0c85-4845-bdc5-d666ed96b205 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.377743] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.578709] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.578939] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.579036] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.579364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.579473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.579836] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.579931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.580030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.580231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.580342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.580502] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 1110.612361] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.612361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.612361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.612544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.612679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.624474] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 1110.783043] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.783177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.783177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.783475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.783583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.783777] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d61543-0c85-4845-bdc5-d666ed96b205 already deleted. [ 1110.783777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.784141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.784141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.784225] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.855785] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 in Status: SUCCESS [ 1110.856147] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.856421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.856873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.857311] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.857548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.857823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.857900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.858027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.858656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.858885] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.333723] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.334050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.334050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.334144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.334195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.334304] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d61543-0c85-4845-bdc5-d666ed96b205 already deleted. [ 1111.334483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.361581] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.864656] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1d8093c-cd24-42d6-a98f-e99ee4f38b99: rpc.has_security_group_logging(os_id): False [ 1111.889293] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.889492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.889534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.889739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.889824] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.890115] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.890215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.890281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.890442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.890520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.890609] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 is going to be created. [ 1112.008477] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.008620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.008687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.008948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.009144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.025907] env[65553]: INFO networking_nsxv3.common.synchronization [None req-9bb5b7c1-1b82-48df-8583-097177287b6d tempest-AttachInterfacesTestJSON-1030263107 tempest-AttachInterfacesTestJSON-1030263107-project-member] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 1112.026883] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 in Status: IN_PROGRESS for 2s [ 1112.028783] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGHEST for action security_group_members [ 1112.029410] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.029634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.029898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.030290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.031417] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.031417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.031417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.031417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.031417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.031417] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.534879] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.535219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.535219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.535331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.535452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.535594] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.535687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.535736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.535883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.535959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.536054] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be updated. [ 1112.719077] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.719256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.719299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.719497] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.719633] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.730421] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 1112.730596] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 deletion is rescheduled due to dependency. [ 1112.730638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.731391] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: IN_PROGRESS for 2s [ 1112.750822] env[65553]: INFO networking_nsxv3.common.synchronization [req-28084fd8-704d-43bd-a569-186361c961e4 req-693256fc-dacc-43d2-9551-6a45ea87e768 tempest-ServersNegativeTestMultiTenantJSON-687762692 tempest-ServersNegativeTestMultiTenantJSON-687762692-project-member] Enqueued Resource ID: 8d626d81-6003-4f84-b690-4708f139d600 with Priority: HIGHEST for action security_group_members [ 1112.752059] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d626d81-6003-4f84-b690-4708f139d600 with Priority: HIGHEST for action security_group_members [ 1112.752059] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d626d81-6003-4f84-b690-4708f139d600 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.752059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.752059] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.752263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.752263] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.752387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.752439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.752563] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.752644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.752764] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d626d81-6003-4f84-b690-4708f139d600',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.078709] env[65553]: INFO networking_nsxv3.common.synchronization [req-5a5c616a-9020-4c56-a6b0-d01dce3240c0 req-465a52e0-eb14-4bb6-bfbd-fe346d2a75b2 tempest-AttachVolumeTestJSON-579631701 tempest-AttachVolumeTestJSON-579631701-project-member] Enqueued Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_members [ 1113.079507] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGHEST for action security_group_members [ 1113.079775] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb67cc18-9ceb-429a-844d-a60317217b7b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.080139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.080139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.080139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.080300] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.080401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.080453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.080597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.080676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.080763] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.254722] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.254888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.254955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.255196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.255282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.255488] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.255580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.255636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.255791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.255863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.255944] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d626d81-6003-4f84-b690-4708f139d600 is going to be updated. [ 1113.287008] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.287176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.287253] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.287467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.287611] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.310028] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d626d81-6003-4f84-b690-4708f139d600 in Status: IN_PROGRESS for 2s [ 1113.583269] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.583532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.583532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.583710] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.606315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.606655] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.606929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.606929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.607033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.607082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.607165] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb67cc18-9ceb-429a-844d-a60317217b7b is going to be updated. [ 1113.634726] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.634912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.634912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.635153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.635299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.645209] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb67cc18-9ceb-429a-844d-a60317217b7b in Status: IN_PROGRESS for 2s [ 1114.042374] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 in Status: SUCCESS [ 1114.042374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.746251] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 in Status: SUCCESS [ 1114.746251] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 deletion is rescheduled due to dependency. [ 1114.746251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.325019] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d626d81-6003-4f84-b690-4708f139d600 in Status: SUCCESS [ 1115.325318] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d626d81-6003-4f84-b690-4708f139d600 deletion is rescheduled due to dependency. [ 1115.325318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.657536] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb67cc18-9ceb-429a-844d-a60317217b7b in Status: SUCCESS [ 1115.657536] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb67cc18-9ceb-429a-844d-a60317217b7b deletion is rescheduled due to dependency. [ 1115.657759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.133283] env[65553]: INFO networking_nsxv3.common.synchronization [None req-7183df23-92c2-4c51-9e3a-bc3eb4774c43 None None] Enqueued Resource ID: d02d393b-0e8e-473e-a20b-91f88c553286 with Priority: HIGHEST for action port [ 1117.134476] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d02d393b-0e8e-473e-a20b-91f88c553286 with Priority: HIGHEST for action port [ 1117.134928] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d02d393b-0e8e-473e-a20b-91f88c553286 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.135194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d02d393b-0e8e-473e-a20b-91f88c553286" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.135194] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d02d393b-0e8e-473e-a20b-91f88c553286" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.135431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d02d393b-0e8e-473e-a20b-91f88c553286" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.135572] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d02d393b-0e8e-473e-a20b-91f88c553286',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.638465] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d02d393b-0e8e-473e-a20b-91f88c553286 [ 1117.638629] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.639889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.639889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.639889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.639889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.639889] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d02d393b-0e8e-473e-a20b-91f88c553286 already deleted. [ 1117.639889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d02d393b-0e8e-473e-a20b-91f88c553286" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.027864] env[65553]: INFO networking_nsxv3.common.synchronization [req-ec7f308a-332d-4c9f-862c-5ab1359cbcaa req-8bd027c0-3bf3-4ca5-84c2-fbfe93801bfb tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1118.028246] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1118.029558] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.029703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.029860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.031202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.031202] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.031202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.031202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.031202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.031202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.031202] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.394883] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.395219] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.395260] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.395551] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.395833] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.396653] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.396799] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.397087] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.397708] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.397708] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.397708] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.397909] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.397909] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.397971] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.398882] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.398882] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.420680] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.421102] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1118.421260] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.421477] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.422238] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-e9e59b90-d74c-4b12-ae4c-952954f5f0b7 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.422430] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-e9e59b90-d74c-4b12-ae4c-952954f5f0b7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.422550] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-e9e59b90-d74c-4b12-ae4c-952954f5f0b7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.422896] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-e9e59b90-d74c-4b12-ae4c-952954f5f0b7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.423008] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9e59b90-d74c-4b12-ae4c-952954f5f0b7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.533580] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.533726] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.533801] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.533998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.534190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.534399] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.534498] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.534550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.534693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.534767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.534855] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1118.559812] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.560079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.560201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.560589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.560815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.571176] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1118.925186] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.925463] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.925552] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.925817] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.925967] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.926130] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port e9e59b90-d74c-4b12-ae4c-952954f5f0b7 not found, creating... [ 1118.926390] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.926550] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.926673] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.926985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.927297] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.927667] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.927954] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.928362] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.928777] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.928985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.929191] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: e9e59b90-d74c-4b12-ae4c-952954f5f0b7 is going to be created. [ 1118.953405] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.953608] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.953728] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.954012] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.954250] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.954464] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-e9e59b90-d74c-4b12-ae4c-952954f5f0b7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.764645] env[65553]: INFO networking_nsxv3.common.synchronization [req-ec7f308a-332d-4c9f-862c-5ab1359cbcaa req-4cb53157-0a01-4ed3-97d8-60b4c383a1f1 service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 1119.764927] env[65553]: INFO networking_nsxv3.common.synchronization [req-ec7f308a-332d-4c9f-862c-5ab1359cbcaa req-4cb53157-0a01-4ed3-97d8-60b4c383a1f1 service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1119.764969] env[65553]: INFO networking_nsxv3.common.synchronization [req-ec7f308a-332d-4c9f-862c-5ab1359cbcaa req-4cb53157-0a01-4ed3-97d8-60b4c383a1f1 service nova] Enqueued Resource ID: e9e59b90-d74c-4b12-ae4c-952954f5f0b7 with Priority: HIGHEST for action port [ 1119.765498] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 1119.765694] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1119.765850] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9e59b90-d74c-4b12-ae4c-952954f5f0b7 with Priority: HIGHEST for action port [ 1119.766228] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.766363] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.766436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.766689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.766774] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.767660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.767764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.767913] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9e59b90-d74c-4b12-ae4c-952954f5f0b7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.768021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9e59b90-d74c-4b12-ae4c-952954f5f0b7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.768086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9e59b90-d74c-4b12-ae4c-952954f5f0b7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.768248] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9e59b90-d74c-4b12-ae4c-952954f5f0b7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.768320] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9e59b90-d74c-4b12-ae4c-952954f5f0b7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.897382] env[65553]: INFO networking_nsxv3.common.synchronization [None req-cbba55fb-53ce-4b1e-9a6a-c1aebd391790 None None] Enqueued Resource ID: a54662fa-d3e8-4185-bcf5-c8487e52aa78 with Priority: HIGHEST for action port [ 1119.898160] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a54662fa-d3e8-4185-bcf5-c8487e52aa78 with Priority: HIGHEST for action port [ 1119.898247] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-a54662fa-d3e8-4185-bcf5-c8487e52aa78 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.898371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a54662fa-d3e8-4185-bcf5-c8487e52aa78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.898448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a54662fa-d3e8-4185-bcf5-c8487e52aa78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.898714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a54662fa-d3e8-4185-bcf5-c8487e52aa78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.898795] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a54662fa-d3e8-4185-bcf5-c8487e52aa78',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.270511] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.270645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.270832] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9e59b90-d74c-4b12-ae4c-952954f5f0b7 with status ACTIVE [ 1120.270996] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.271119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.271252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.271457] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.271544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.271714] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.271806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.271866] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.272275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.272275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.272275] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.272382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.272452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.272553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.272623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.272706] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9e59b90-d74c-4b12-ae4c-952954f5f0b7 is going to be updated. [ 1120.297459] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.297595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.297644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.297859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.297983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.298320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9e59b90-d74c-4b12-ae4c-952954f5f0b7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.360345] env[65553]: INFO networking_nsxv3.common.synchronization [req-fde33bbf-3f62-4cc5-b110-36ac5c9461a2 req-a28b8656-f0d7-44fe-86d1-8ebeafe988fb tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1120.360345] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1120.360345] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.360345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.360345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.360594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.360594] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.360660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.360712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.361024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.361024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.361024] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.402856] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a54662fa-d3e8-4185-bcf5-c8487e52aa78 [ 1120.402856] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.402856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.402856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.402856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.402856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.403128] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a54662fa-d3e8-4185-bcf5-c8487e52aa78 already deleted. [ 1120.403128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a54662fa-d3e8-4185-bcf5-c8487e52aa78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.582433] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1120.582617] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 1120.582820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.582991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.583220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.583403] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.583519] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.583582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.583733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.583811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.583905] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.707412] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.707535] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.707582] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.707954] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.708517] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.708686] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.708811] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.709103] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.709390] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.709525] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.709634] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.709742] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.709850] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.709961] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.710119] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.710250] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.729033] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.729213] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1120.729356] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.729529] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-829" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.729857] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-155af700-828e-4b53-9677-efd627357162 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.730045] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-155af700-828e-4b53-9677-efd627357162" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.730235] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-155af700-828e-4b53-9677-efd627357162" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.730547] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-155af700-828e-4b53-9677-efd627357162" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.730719] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('155af700-828e-4b53-9677-efd627357162',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.866165] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.866479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.866479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.866688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.866783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.867041] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.867135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.867202] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.867376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.867457] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.867547] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 1120.892810] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.892999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.893052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.893269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.893492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.902606] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 1121.087456] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.232895] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.233185] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.233313] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.233612] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.233762] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.233917] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 155af700-828e-4b53-9677-efd627357162 not found, creating... [ 1121.234304] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.234503] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.234620] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.234835] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.234971] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.235274] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.235427] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.235537] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.235760] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.236217] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.236382] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 155af700-828e-4b53-9677-efd627357162 is going to be created. [ 1121.258320] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.258506] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.258625] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.258931] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.259170] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.259398] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-155af700-828e-4b53-9677-efd627357162" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.590240] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.012022] env[65553]: INFO networking_nsxv3.common.synchronization [req-fde33bbf-3f62-4cc5-b110-36ac5c9461a2 req-4b8b59ff-4531-4387-a118-fe0bbc37af69 service nova] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_rules [ 1122.012311] env[65553]: INFO networking_nsxv3.common.synchronization [req-fde33bbf-3f62-4cc5-b110-36ac5c9461a2 req-4b8b59ff-4531-4387-a118-fe0bbc37af69 service nova] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1122.012311] env[65553]: INFO networking_nsxv3.common.synchronization [req-fde33bbf-3f62-4cc5-b110-36ac5c9461a2 req-4b8b59ff-4531-4387-a118-fe0bbc37af69 service nova] Enqueued Resource ID: 155af700-828e-4b53-9677-efd627357162 with Priority: HIGHEST for action port [ 1122.012814] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_rules [ 1122.013112] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1122.013330] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 155af700-828e-4b53-9677-efd627357162 with Priority: HIGHEST for action port [ 1122.013731] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.013954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.014312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.014376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.014481] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.015520] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.015669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.015919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-155af700-828e-4b53-9677-efd627357162 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.016138] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-155af700-828e-4b53-9677-efd627357162" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.016241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-155af700-828e-4b53-9677-efd627357162" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.016492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-155af700-828e-4b53-9677-efd627357162" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.016616] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('155af700-828e-4b53-9677-efd627357162',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.093185] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.093185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.093185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.093384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.093384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.093441] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1122.129424] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.129424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.129424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.129638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.129638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.139434] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1122.519086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.519235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.519427] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 155af700-828e-4b53-9677-efd627357162 with status ACTIVE [ 1122.519612] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.519775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.519775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.520047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.520132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.520328] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.520396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.520554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.520649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.520682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.520934] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.521039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.521098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.521244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.521848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.521848] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 155af700-828e-4b53-9677-efd627357162 is going to be updated. [ 1122.543492] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.543638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.543687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.544175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.544248] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.544341] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-155af700-828e-4b53-9677-efd627357162" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.637797] env[65553]: INFO networking_nsxv3.common.synchronization [req-64a8657b-edb3-4e67-bbcc-700b51bc99b5 req-b464ed2e-3375-414e-a60f-809c1db4f512 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_members [ 1122.638314] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_members [ 1122.638619] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d61543-0c85-4845-bdc5-d666ed96b205 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.639295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.639295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.639295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.639295] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.639468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.639468] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.639524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.639806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.639806] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.915100] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 1122.915290] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 deletion is rescheduled due to dependency. [ 1122.915399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.915582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.916775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.916775] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.916775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.916775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.916775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.916775] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.917128] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.969495] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.969695] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.969836] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.970187] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.970437] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.970589] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.970700] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.970910] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.971075] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.971318] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.971430] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.971533] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.971636] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.971741] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.971840] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.971968] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.990136] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.990309] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.990441] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.990631] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-859" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.990943] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-05cbd83f-2eff-47ce-82d1-19371ab50d79 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.991169] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-05cbd83f-2eff-47ce-82d1-19371ab50d79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.991301] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-05cbd83f-2eff-47ce-82d1-19371ab50d79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.991635] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-05cbd83f-2eff-47ce-82d1-19371ab50d79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.991768] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cbd83f-2eff-47ce-82d1-19371ab50d79',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.142491] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.142772] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.142772] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.142914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.142999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.143217] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.143315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.143393] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.143516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.143590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.143672] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d61543-0c85-4845-bdc5-d666ed96b205 already deleted. [ 1123.143751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.419566] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.494751] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.495051] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.495288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.495706] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.495901] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.496130] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 05cbd83f-2eff-47ce-82d1-19371ab50d79 not found, creating... [ 1123.496499] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.496687] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.496806] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.497087] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.497218] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.497564] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.497779] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.497969] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.498240] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.498465] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.498567] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 05cbd83f-2eff-47ce-82d1-19371ab50d79 is going to be created. [ 1123.526386] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.526631] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.526765] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.527075] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.527377] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.527638] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-05cbd83f-2eff-47ce-82d1-19371ab50d79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.923015] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.160595] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1124.161970] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.162790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.165620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.165620] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.165620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.165620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.165620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.165620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.165620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.165620] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.309812] env[65553]: INFO networking_nsxv3.common.synchronization [req-64a8657b-edb3-4e67-bbcc-700b51bc99b5 req-5a7686c7-6689-4296-a023-217e4de47211 service nova] Enqueued Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_rules [ 1124.310194] env[65553]: INFO networking_nsxv3.common.synchronization [req-64a8657b-edb3-4e67-bbcc-700b51bc99b5 req-5a7686c7-6689-4296-a023-217e4de47211 service nova] Enqueued Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_members [ 1124.310350] env[65553]: INFO networking_nsxv3.common.synchronization [req-64a8657b-edb3-4e67-bbcc-700b51bc99b5 req-5a7686c7-6689-4296-a023-217e4de47211 service nova] Enqueued Resource ID: 05cbd83f-2eff-47ce-82d1-19371ab50d79 with Priority: HIGHEST for action port [ 1124.311336] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_rules [ 1124.311532] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_members [ 1124.311683] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05cbd83f-2eff-47ce-82d1-19371ab50d79 with Priority: HIGHEST for action port [ 1124.312016] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d61543-0c85-4845-bdc5-d666ed96b205 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.312243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.312243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.312815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.312815] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.313916] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d61543-0c85-4845-bdc5-d666ed96b205 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.314035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.314095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.315052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.315052] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.315052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.315052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.315052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.315052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.315283] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.316436] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-05cbd83f-2eff-47ce-82d1-19371ab50d79 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.316592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05cbd83f-2eff-47ce-82d1-19371ab50d79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.316592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05cbd83f-2eff-47ce-82d1-19371ab50d79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.317809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05cbd83f-2eff-47ce-82d1-19371ab50d79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.317809] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cbd83f-2eff-47ce-82d1-19371ab50d79',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.426413] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.426586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.426665] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.426895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.427032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.427144] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 1124.483272] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.483272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.483272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.483272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.483272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.494642] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 1124.667617] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.667828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.667961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.668242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.668464] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.668600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.668688] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.668889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.669086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.669209] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.669417] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.669542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.669618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.669814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.670013] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.670153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.670241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.670421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.670534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.670633] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.670753] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.819645] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.820791] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d61543-0c85-4845-bdc5-d666ed96b205 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.820937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.821078] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05cbd83f-2eff-47ce-82d1-19371ab50d79 with status ACTIVE [ 1124.821449] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.821597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.821660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.821880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.821996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.822207] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.822309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.822372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.822538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.822615] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.822795] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.822887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.822946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.823128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.823206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.823292] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05cbd83f-2eff-47ce-82d1-19371ab50d79 is going to be updated. [ 1124.851133] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.851522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.851631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.851791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.851934] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.852129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05cbd83f-2eff-47ce-82d1-19371ab50d79" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.172709] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9009da09-3880-4f06-b8cc-6f3ff62a7fbd: rpc.has_security_group_logging(os_id): False [ 1125.195287] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.195516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.195572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.195812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.195924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.196191] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.196338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.196417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.196671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.196768] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.196959] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.197101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.197166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.197308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.197382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.197611] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.197706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.197813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.197977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.198099] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.198209] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1125.278745] env[65553]: INFO networking_nsxv3.common.synchronization [req-d12e64af-bc40-4991-a6a8-42fabd54c317 req-a444e1fa-c4de-4033-8e5d-12adf6a95d44 tempest-ServersNegativeTestJSON-1019655983 tempest-ServersNegativeTestJSON-1019655983-project-member] Enqueued Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 1125.279346] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f with Priority: HIGHEST for action security_group_members [ 1125.279658] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d5d7b40-1056-43d4-a9d4-099288f67f0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.279762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.279835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.280579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.280746] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.280851] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.280913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.281146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.281327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.281437] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d5d7b40-1056-43d4-a9d4-099288f67f0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.285366] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.285509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.285547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.285721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.285858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.313809] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1125.326131] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.783967] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.784149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.784237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.784431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.784522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.784728] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.784829] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.784888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.785028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.785100] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.785186] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f is going to be updated. [ 1125.816445] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.816668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.816668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.816900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.817077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.826298] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: IN_PROGRESS for 2s [ 1125.828100] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.828254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.828302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.828529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.828652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.828764] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d61543-0c85-4845-bdc5-d666ed96b205 is going to be created. [ 1125.853665] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.853893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.853893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.854143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.854314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.866171] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d61543-0c85-4845-bdc5-d666ed96b205 in Status: UNINITIALIZED for 2s [ 1126.512708] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 1126.512708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.512708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.512708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.512708] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.512708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.512708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.513884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.513884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.513884] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.513884] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.023972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.023972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.023972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.023972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.023972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.024629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.024629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.024629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.024629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.024629] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.333323] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1127.333567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.529358] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b60f68fd-25de-4d38-bc93-3e4066ff8aa6: rpc.has_security_group_logging(os_id): False [ 1127.549012] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.549237] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.549318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.549535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.549625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.549832] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.549932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.549993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.550238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.550337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.550765] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.550765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.550765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.550911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.550911] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.551521] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.551650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.551713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.551870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.551946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.552047] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 1127.636018] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.636018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.636018] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.636274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.636274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.654387] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 1127.765928] env[65553]: INFO networking_nsxv3.common.synchronization [None req-db3864f1-e51d-4c83-883b-4c590aba4e00 tempest-AttachVolumeTestJSON-579631701 tempest-AttachVolumeTestJSON-579631701-project-member] Enqueued Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_rules [ 1127.767414] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_rules [ 1127.767414] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-537bc2bc-cdf2-4458-b7d2-e407a1378139 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.767414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.767414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.767734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.768127] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.837459] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f in Status: SUCCESS [ 1127.838608] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d5d7b40-1056-43d4-a9d4-099288f67f0f deletion is rescheduled due to dependency. [ 1127.838608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d5d7b40-1056-43d4-a9d4-099288f67f0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.878529] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d61543-0c85-4845-bdc5-d666ed96b205 in Status: SUCCESS [ 1127.878757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.878910] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.879223] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.879407] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.879523] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.879583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.879736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.879809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.880870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.880870] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.912188] env[65553]: INFO networking_nsxv3.common.synchronization [None req-226e80d9-8e78-4b59-af5b-8d6389e462b8 tempest-AttachVolumeTestJSON-579631701 tempest-AttachVolumeTestJSON-579631701-project-member] Enqueued Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_rules [ 1127.912883] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_rules [ 1127.913718] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-537bc2bc-cdf2-4458-b7d2-e407a1378139 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.913854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.293351] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.293550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.293631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.293930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.294839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.294839] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 already deleted. [ 1128.294839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.294839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.294839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.294839] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.382405] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.704249] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-f0528994-9fec-40a1-8c56-75427107350e tempest-ServersTestMultiNic-1539507516 tempest-ServersTestMultiNic-1539507516-project-member] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1128.704249] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1128.704249] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.704249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.704249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.706066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.706140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.706537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.706537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.706610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.706706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.707736] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.822260] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.822260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.822260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.822509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.822509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.822509] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 already deleted. [ 1128.822624] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.886379] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45d61543-0c85-4845-bdc5-d666ed96b205: rpc.has_security_group_logging(os_id): False [ 1128.904668] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.904814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.904887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.905176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.905299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.905529] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.905633] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.905694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.905882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.905945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.906056] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d61543-0c85-4845-bdc5-d666ed96b205 is going to be created. [ 1128.977816] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.978043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.978158] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.978480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.978777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.990462] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d61543-0c85-4845-bdc5-d666ed96b205 in Status: IN_PROGRESS for 2s [ 1129.065837] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-0491cfc8-752a-4aeb-bf16-282a7febade3 tempest-ServersTestMultiNic-1539507516 tempest-ServersTestMultiNic-1539507516-project-member] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1129.067422] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1129.067980] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.068193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.210192] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.210520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.210671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.210965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.213748] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.213748] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 already deleted. [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.213748] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.213748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.213748] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.460289] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-586abd65-8b0c-42e9-8eff-ef62c54260d1 tempest-ServersTestMultiNic-1539507516 tempest-ServersTestMultiNic-1539507516-project-member] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1129.461104] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1129.461513] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.461649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.671501] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 1129.673362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.716026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.716539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.716539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.716539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.716539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.717218] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.717218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.717218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.717218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.717218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.718178] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 already deleted. [ 1129.718178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.718178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.718178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.718178] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.718178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.718178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.718178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.718441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.718441] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.896565] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-42 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.896796] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-42" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.896993] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-42" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.897384] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-42" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.897647] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.897810] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.897947] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.898215] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.898421] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.898699] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.898885] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.899316] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.899316] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.899410] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.899515] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.899614] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.921653] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.921824] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1129.921963] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.922158] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-42" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.922472] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-9c9c0ed7-dc59-4fbd-8b80-919192b7bbff taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.922737] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-9c9c0ed7-dc59-4fbd-8b80-919192b7bbff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.922931] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-9c9c0ed7-dc59-4fbd-8b80-919192b7bbff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.923172] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-9c9c0ed7-dc59-4fbd-8b80-919192b7bbff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.923228] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c9c0ed7-dc59-4fbd-8b80-919192b7bbff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.222034] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.222034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.222034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.222034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.222034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.222034] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.222034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.222034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.222541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.222541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.222541] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 already deleted. [ 1130.222541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.425924] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.426418] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.427080] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.427080] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.427882] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.427882] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 9c9c0ed7-dc59-4fbd-8b80-919192b7bbff not found, creating... [ 1130.427882] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.427882] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.428120] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.428189] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.428326] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.428624] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.428779] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.428894] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.429197] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.429337] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.429476] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 9c9c0ed7-dc59-4fbd-8b80-919192b7bbff is going to be created. [ 1130.454923] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.454923] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.454923] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.455216] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.455216] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.455891] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-9c9c0ed7-dc59-4fbd-8b80-919192b7bbff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.003143] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45d61543-0c85-4845-bdc5-d666ed96b205 in Status: SUCCESS [ 1131.003457] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.154868] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-e96b302f-c299-4dec-9ce0-3f8e77974c42 service nova] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_rules [ 1131.155062] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-e96b302f-c299-4dec-9ce0-3f8e77974c42 service nova] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1131.155231] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-e96b302f-c299-4dec-9ce0-3f8e77974c42 service nova] Enqueued Resource ID: 9c9c0ed7-dc59-4fbd-8b80-919192b7bbff with Priority: HIGHEST for action port [ 1131.155795] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_rules [ 1131.155938] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1131.156162] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c9c0ed7-dc59-4fbd-8b80-919192b7bbff with Priority: HIGHEST for action port [ 1131.156467] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.156635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.156670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.156995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.157084] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.157909] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.158051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.159238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.159238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.159238] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.159238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.159238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.159238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.159238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.159238] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.159886] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c9c0ed7-dc59-4fbd-8b80-919192b7bbff taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.159952] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c9c0ed7-dc59-4fbd-8b80-919192b7bbff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.160008] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c9c0ed7-dc59-4fbd-8b80-919192b7bbff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.160425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c9c0ed7-dc59-4fbd-8b80-919192b7bbff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.160509] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c9c0ed7-dc59-4fbd-8b80-919192b7bbff',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.666108] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.666248] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.669026] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.669026] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c9c0ed7-dc59-4fbd-8b80-919192b7bbff with status ACTIVE [ 1131.669026] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.669026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.669026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.669026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.669026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.669418] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.669418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.669418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.669592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.670020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.670020] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.670020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.670896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.671514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.671731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.671837] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c9c0ed7-dc59-4fbd-8b80-919192b7bbff is going to be updated. [ 1131.698083] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.698308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.698351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.698567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.698714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.698879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c9c0ed7-dc59-4fbd-8b80-919192b7bbff" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.952510] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.952704] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-106" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.952839] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-106" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.953440] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-106" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.953440] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.953789] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.953789] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.953916] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.954173] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.954419] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.954536] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.954629] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.954747] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.954854] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1131.954957] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.955093] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.023335] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.023733] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.068 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1132.023808] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.024042] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-106" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.024471] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-9870ee99-7feb-47fd-b6ff-e123fac262e9 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.024656] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-9870ee99-7feb-47fd-b6ff-e123fac262e9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.024810] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-9870ee99-7feb-47fd-b6ff-e123fac262e9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.025320] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-9870ee99-7feb-47fd-b6ff-e123fac262e9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.025529] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9870ee99-7feb-47fd-b6ff-e123fac262e9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.174881] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.531077] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.531077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.531077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.531077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.531077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.531077] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 9870ee99-7feb-47fd-b6ff-e123fac262e9 not found, creating... [ 1132.531077] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.531077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.531077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.531077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.531077] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.531662] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.531780] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.532028] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.532367] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.532846] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.533274] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 9870ee99-7feb-47fd-b6ff-e123fac262e9 is going to be created. [ 1132.556229] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.556229] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.556229] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.556229] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.556229] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.556229] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-9870ee99-7feb-47fd-b6ff-e123fac262e9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.679154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.679878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.679878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.679993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.680150] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.680269] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be created. [ 1132.727454] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.727706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.727706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.727826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.727999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.738765] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: UNINITIALIZED for 2s [ 1133.228017] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-9985c27a-86da-4b42-ae20-4c49d953f233 service nova] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_rules [ 1133.228017] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-9985c27a-86da-4b42-ae20-4c49d953f233 service nova] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1133.228017] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-9985c27a-86da-4b42-ae20-4c49d953f233 service nova] Enqueued Resource ID: 9870ee99-7feb-47fd-b6ff-e123fac262e9 with Priority: HIGHEST for action port [ 1133.228017] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_rules [ 1133.228017] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1133.228956] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9870ee99-7feb-47fd-b6ff-e123fac262e9 with Priority: HIGHEST for action port [ 1133.231400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.231400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.231400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.231400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.231400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9870ee99-7feb-47fd-b6ff-e123fac262e9 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.231400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9870ee99-7feb-47fd-b6ff-e123fac262e9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.231400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9870ee99-7feb-47fd-b6ff-e123fac262e9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.231400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9870ee99-7feb-47fd-b6ff-e123fac262e9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.231400] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9870ee99-7feb-47fd-b6ff-e123fac262e9',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.461993] env[65553]: INFO networking_nsxv3.common.synchronization [req-8a18922f-54eb-4adc-8574-bdaf2fa980df req-60f0d651-95d4-48e2-97b5-e88a3b772c22 tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1133.463245] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1133.463338] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.463499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.463606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.463795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.463960] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.464074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.464137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.464296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.464391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.464485] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.733779] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9870ee99-7feb-47fd-b6ff-e123fac262e9 with status ACTIVE [ 1133.733779] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.733779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.733779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.734000] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.734111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.734551] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.734551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.734551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.734704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.734768] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.734953] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.735064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.735167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.735366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.735446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.735531] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9870ee99-7feb-47fd-b6ff-e123fac262e9 is going to be updated. [ 1133.759255] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.759439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.759507] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.759662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.759800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.759954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9870ee99-7feb-47fd-b6ff-e123fac262e9" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.968511] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.968511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.968511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.968786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.968870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.969144] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.969374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.969374] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.969559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.969559] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.969660] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1134.004399] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.004871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.004871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.004871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.005072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.009900] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-42 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.010268] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-42" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.010268] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-42" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.010541] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-42" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.010805] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.011624] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.011710] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.012861] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.013055] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.013345] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1134.013396] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1134.013483] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1134.013625] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1134.013741] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1134.013870] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1134.014021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1134.015958] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1134.044029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1134.044834] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1134.044834] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1134.045046] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-42" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.046660] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-5b574320-c292-43d8-a5e0-12add728a198 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.047067] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-5b574320-c292-43d8-a5e0-12add728a198" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.047280] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-5b574320-c292-43d8-a5e0-12add728a198" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.047719] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-5b574320-c292-43d8-a5e0-12add728a198" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.048425] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b574320-c292-43d8-a5e0-12add728a198',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.551151] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.551544] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.551544] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.551741] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.551888] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.552055] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 5b574320-c292-43d8-a5e0-12add728a198 not found, creating... [ 1134.552418] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.552585] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.552702] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.552930] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.553081] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.553371] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.553525] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.553637] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.553843] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.553974] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.554128] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 5b574320-c292-43d8-a5e0-12add728a198 is going to be created. [ 1134.579587] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.579879] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.580221] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.580421] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.580704] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.580989] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-5b574320-c292-43d8-a5e0-12add728a198" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.751370] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1134.751609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.751797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.752034] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.752267] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.752394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.752461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.752630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.752709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.752800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.752885] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.753822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.754012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.754454] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.754643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.754718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.754808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.754878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.754972] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.257731] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.257731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.261083] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.318444] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-8cbe408e-5137-49dc-a23b-77d83cf17617 service nova] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_rules [ 1135.318444] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-8cbe408e-5137-49dc-a23b-77d83cf17617 service nova] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1135.318444] env[65553]: INFO networking_nsxv3.common.synchronization [req-244b6fe0-d5a9-4457-b629-675dd6f8da5e req-8cbe408e-5137-49dc-a23b-77d83cf17617 service nova] Enqueued Resource ID: 5b574320-c292-43d8-a5e0-12add728a198 with Priority: HIGHEST for action port [ 1135.318444] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_rules [ 1135.319633] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1135.319927] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b574320-c292-43d8-a5e0-12add728a198 with Priority: HIGHEST for action port [ 1135.320847] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.322191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.322774] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.324031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.324031] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b574320-c292-43d8-a5e0-12add728a198 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.324031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b574320-c292-43d8-a5e0-12add728a198" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.324031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b574320-c292-43d8-a5e0-12add728a198" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.325430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b574320-c292-43d8-a5e0-12add728a198" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.325430] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b574320-c292-43d8-a5e0-12add728a198',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.556680] env[65553]: INFO networking_nsxv3.common.synchronization [req-0a89f472-9b75-4de5-8853-98120cf1731a req-4bc19e94-dee1-4acc-8d25-075906aa4b49 tempest-AttachVolumeTestJSON-579631701 tempest-AttachVolumeTestJSON-579631701-project-member] Enqueued Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_members [ 1135.557540] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_members [ 1135.557917] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-537bc2bc-cdf2-4458-b7d2-e407a1378139 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.558060] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.558136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.558376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.558972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.558972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.558972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.559246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.559246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.559315] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.765251] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.830029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b574320-c292-43d8-a5e0-12add728a198 with status ACTIVE [ 1135.830029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.830029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.830029] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.830029] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.830029] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b574320-c292-43d8-a5e0-12add728a198 is going to be updated. [ 1135.853312] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.853488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.853525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.854161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.854161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.854161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b574320-c292-43d8-a5e0-12add728a198" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.912796] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.913131] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-895" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.913269] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-895" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.913611] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-895" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.913915] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.914083] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.914195] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.914480] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.914636] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.914897] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.915038] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.915158] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.915391] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.915458] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.915540] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.915668] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.940384] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.940582] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.940737] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.940931] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-895" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.941302] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-64334821-3ce5-44f0-b7b7-a9f08af9a41c taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.941505] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-64334821-3ce5-44f0-b7b7-a9f08af9a41c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.941626] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-64334821-3ce5-44f0-b7b7-a9f08af9a41c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.941998] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-64334821-3ce5-44f0-b7b7-a9f08af9a41c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.942202] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64334821-3ce5-44f0-b7b7-a9f08af9a41c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.983784] env[65553]: INFO networking_nsxv3.common.synchronization [req-8b7a6b5c-c5a6-4d64-b897-4b9b66f3a3aa req-b7a7a3c2-d054-4380-be5e-e0f9b2e44770 tempest-ServerDiskConfigTestJSON-532429242 tempest-ServerDiskConfigTestJSON-532429242-project-member] Enqueued Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1135.983784] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 with Priority: HIGHEST for action security_group_members [ 1135.983914] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.983970] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.984025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.984414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.984414] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.984529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.984576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.984727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.984808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.984899] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b60f68fd-25de-4d38-bc93-3e4066ff8aa6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.026076] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1136.026354] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 1136.026415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.062296] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.062486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.062530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.062724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.062810] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.063040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.063198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.063198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.063364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.063488] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.063543] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 already deleted. [ 1136.063577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.267024] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.267024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.267024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.267251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.267251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.267310] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1136.300977] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.301152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.301211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.301462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.301620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.320183] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1136.445828] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.446174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.446282] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.446520] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.446672] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.446830] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 64334821-3ce5-44f0-b7b7-a9f08af9a41c not found, creating... [ 1136.447112] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.447272] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.447386] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.447614] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.447745] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.448044] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.448747] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.449040] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.449570] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.450251] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.450440] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 64334821-3ce5-44f0-b7b7-a9f08af9a41c is going to be created. [ 1136.472114] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.472380] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.472504] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.472820] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.473092] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.473373] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-64334821-3ce5-44f0-b7b7-a9f08af9a41c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.487965] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.487965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.487965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.487965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.487965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.487965] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.487965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.487965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.488373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.488373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.488373] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 is going to be updated. [ 1136.526935] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.527096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.527158] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.527366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.527502] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.536585] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: IN_PROGRESS for 2s [ 1137.178258] env[65553]: INFO networking_nsxv3.common.synchronization [req-0a89f472-9b75-4de5-8853-98120cf1731a req-bc99fa25-b7ac-42bc-9a83-9a8990b209e4 service nova] Enqueued Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_rules [ 1137.178793] env[65553]: INFO networking_nsxv3.common.synchronization [req-0a89f472-9b75-4de5-8853-98120cf1731a req-bc99fa25-b7ac-42bc-9a83-9a8990b209e4 service nova] Enqueued Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_members [ 1137.178793] env[65553]: INFO networking_nsxv3.common.synchronization [req-0a89f472-9b75-4de5-8853-98120cf1731a req-bc99fa25-b7ac-42bc-9a83-9a8990b209e4 service nova] Enqueued Resource ID: 64334821-3ce5-44f0-b7b7-a9f08af9a41c with Priority: HIGHEST for action port [ 1137.179420] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_rules [ 1137.179603] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_members [ 1137.179751] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64334821-3ce5-44f0-b7b7-a9f08af9a41c with Priority: HIGHEST for action port [ 1137.180071] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-537bc2bc-cdf2-4458-b7d2-e407a1378139 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.180290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.180401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.180638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.180761] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.182106] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-537bc2bc-cdf2-4458-b7d2-e407a1378139 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.182351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.182483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.182785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.184016] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.184238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.184321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.184897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.184897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.184897] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.186108] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-64334821-3ce5-44f0-b7b7-a9f08af9a41c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.186284] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64334821-3ce5-44f0-b7b7-a9f08af9a41c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.186400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64334821-3ce5-44f0-b7b7-a9f08af9a41c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.186580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64334821-3ce5-44f0-b7b7-a9f08af9a41c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.186805] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64334821-3ce5-44f0-b7b7-a9f08af9a41c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.690976] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-537bc2bc-cdf2-4458-b7d2-e407a1378139 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.690976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.690976] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.690976] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64334821-3ce5-44f0-b7b7-a9f08af9a41c with status ACTIVE [ 1137.690976] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.690976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.690976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.690976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.690976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.690976] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.690976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.690976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.691577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.691577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.695025] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.695025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.695025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.695025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.695025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.695025] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64334821-3ce5-44f0-b7b7-a9f08af9a41c is going to be updated. [ 1137.716531] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.716771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.716869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.717260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.717523] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.718015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64334821-3ce5-44f0-b7b7-a9f08af9a41c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.196203] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.248573] env[65553]: INFO networking_nsxv3.common.synchronization [req-47ff961a-036e-4bca-8680-365d70c3f2ce req-9f4d8bcd-641c-41d2-9068-020feb6157dd tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 1138.249564] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 1138.249886] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.250020] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.250181] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.250387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.250541] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.250962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.250962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.250962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.250962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.251205] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.331461] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1138.331684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.331836] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.332069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.332265] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.332377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.332477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.332628] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.332715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.332799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.332960] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.333047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.333106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.333243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.333544] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.333544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.333544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.333751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.333751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.333825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.333943] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.334798] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.334976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.335175] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.335278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.335472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.335472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.335556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.335653] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.548157] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 in Status: SUCCESS [ 1138.548384] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b60f68fd-25de-4d38-bc93-3e4066ff8aa6 deletion is rescheduled due to dependency. [ 1138.548503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b60f68fd-25de-4d38-bc93-3e4066ff8aa6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.698319] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.698542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.698613] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.698782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.699251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.699251] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 is going to be created. [ 1138.732503] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.732845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.732845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.733009] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.733405] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.743697] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 in Status: UNINITIALIZED for 2s [ 1138.753254] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.838340] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 928f1d2f-688e-44af-b91a-cbdcb3b52d50: rpc.has_security_group_logging(os_id): False [ 1138.839623] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.864107] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.864277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.864334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.864533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.864657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.864829] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.864932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.864985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.865154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.865252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.865585] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.865650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.865755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.866572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.866700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.866904] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.867031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.867092] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.867250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.867351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.867484] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be created. [ 1138.943972] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.943972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.943972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.943972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.943972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.046154] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1139.256041] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.341971] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.759738] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.759738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.759738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.759738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.760066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.760066] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 is going to be updated. [ 1139.791951] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.792208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.792292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.792652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.792961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.805576] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: IN_PROGRESS for 2s [ 1139.844271] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.844436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.844494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.844708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.844799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.844902] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1139.880850] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.881041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.881080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.881333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.881483] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.892144] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1140.755066] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 in Status: SUCCESS [ 1140.755554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.755554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.755721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.755911] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.756043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.756103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.756263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.756341] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.756425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.756516] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.062861] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1141.063763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.064617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.064617] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.064972] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.259262] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.567484] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.567614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.761974] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 537bc2bc-cdf2-4458-b7d2-e407a1378139: rpc.has_security_group_logging(os_id): False [ 1141.785138] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.785348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.785348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.785626] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.785723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.785978] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.786108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.786172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.786320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.786419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.786531] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 is going to be created. [ 1141.822083] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: SUCCESS [ 1141.822083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.883990] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.884261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.884261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.884554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.884823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.903019] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 in Status: IN_PROGRESS for 2s [ 1141.904779] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1141.904779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.904779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.904779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.905969] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.905969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.905969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.905969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.905969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.906241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.907240] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.410503] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.410701] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.410838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.411058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.411615] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.411729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.411795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.411951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.412050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.412140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.412291] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.412385] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.412440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.412581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.412718] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.412839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.412889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.412991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.413088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.413227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.413328] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.917701] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 928f1d2f-688e-44af-b91a-cbdcb3b52d50: rpc.has_security_group_logging(os_id): False [ 1142.936823] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.936973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.937068] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.937351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.937444] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.937666] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.937772] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.937829] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.937987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.938078] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.938260] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.938356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.938409] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.938542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.938607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.938793] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.938907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.938970] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.939154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.939287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.939379] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1143.002333] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.002589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.002589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.002808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.002965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.016698] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1143.250442] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1143.250577] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1143.915949] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 in Status: SUCCESS [ 1143.916288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.030108] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1145.030420] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.030538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.030769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.030862] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.536078] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.536242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.536344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.536526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.536707] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.536804] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.536865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.537023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.537112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.537198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.537338] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.735204] env[65553]: INFO networking_nsxv3.common.synchronization [req-0adc1b62-abf1-48c4-a062-e9ab86bc59dc req-45f702c7-ae11-4914-8d38-c381325e95ce tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1145.736312] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1145.736725] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.736853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.736959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.737204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.737405] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.737532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.737612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.737782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.737870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.738089] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.911160] env[65553]: INFO networking_nsxv3.common.synchronization [None req-8653a4c2-1961-46d2-99bb-33cc25d339e7 None None] Enqueued Resource ID: 5e93d839-b6e5-404f-bca8-c8ed0fa41375 with Priority: HIGHEST for action port [ 1145.912109] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e93d839-b6e5-404f-bca8-c8ed0fa41375 with Priority: HIGHEST for action port [ 1145.912109] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e93d839-b6e5-404f-bca8-c8ed0fa41375 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.912631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e93d839-b6e5-404f-bca8-c8ed0fa41375" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.912691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e93d839-b6e5-404f-bca8-c8ed0fa41375" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.912948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e93d839-b6e5-404f-bca8-c8ed0fa41375" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.913039] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e93d839-b6e5-404f-bca8-c8ed0fa41375',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.045834] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.045834] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.045834] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.045834] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.045834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.047241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.047403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.047572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.047672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.047767] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.198351] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.198530] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.198648] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.198902] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.199149] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.199330] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.199449] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.199661] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.201298] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.201298] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.201298] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.201298] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.201298] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.201298] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.201298] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.201298] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.219606] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.219773] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.219823] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.219996] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.220349] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-8aaceb6c-6f45-4031-bad4-0c5b94c59194 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.220526] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-8aaceb6c-6f45-4031-bad4-0c5b94c59194" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.220642] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-8aaceb6c-6f45-4031-bad4-0c5b94c59194" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.220967] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-8aaceb6c-6f45-4031-bad4-0c5b94c59194" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.221119] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8aaceb6c-6f45-4031-bad4-0c5b94c59194',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.242395] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.242545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.242615] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.242819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.242909] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.243110] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.243207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.243293] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.243429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.243509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.243598] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1146.272335] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.272516] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.272565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.272730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.272860] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.283021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1146.415792] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e93d839-b6e5-404f-bca8-c8ed0fa41375 [ 1146.416685] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.416685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.416685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.416861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.416861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.417305] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e93d839-b6e5-404f-bca8-c8ed0fa41375 already deleted. [ 1146.417305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e93d839-b6e5-404f-bca8-c8ed0fa41375" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.551976] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 928f1d2f-688e-44af-b91a-cbdcb3b52d50: rpc.has_security_group_logging(os_id): False [ 1146.571687] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.571959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.572469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.572802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.573956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.574299] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.574391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.574434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.574640] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.574745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.574940] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.575086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.575141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.575263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.575338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.575527] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.575618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.575679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.575818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.575893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.575977] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1146.638513] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.638513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.638513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.638513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.638513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.654195] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1146.723776] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.724033] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.724215] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.724563] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.724741] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.724874] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 8aaceb6c-6f45-4031-bad4-0c5b94c59194 not found, creating... [ 1146.725161] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.725339] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.725565] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.725824] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.726163] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.726313] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.726494] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.726625] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.727106] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.727106] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.727106] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 8aaceb6c-6f45-4031-bad4-0c5b94c59194 is going to be created. [ 1146.773417] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.773710] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.773847] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.774138] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.774485] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.774697] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-8aaceb6c-6f45-4031-bad4-0c5b94c59194" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.516647] env[65553]: INFO networking_nsxv3.common.synchronization [req-0adc1b62-abf1-48c4-a062-e9ab86bc59dc req-6e0cc43a-7c75-4a79-bb79-431b149df46f service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 1147.516647] env[65553]: INFO networking_nsxv3.common.synchronization [req-0adc1b62-abf1-48c4-a062-e9ab86bc59dc req-6e0cc43a-7c75-4a79-bb79-431b149df46f service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1147.517015] env[65553]: INFO networking_nsxv3.common.synchronization [req-0adc1b62-abf1-48c4-a062-e9ab86bc59dc req-6e0cc43a-7c75-4a79-bb79-431b149df46f service nova] Enqueued Resource ID: 8aaceb6c-6f45-4031-bad4-0c5b94c59194 with Priority: HIGHEST for action port [ 1147.517340] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 1147.517481] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1147.517566] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aaceb6c-6f45-4031-bad4-0c5b94c59194 with Priority: HIGHEST for action port [ 1147.517833] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.517958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.521357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.521357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.521595] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.523206] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.523206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.523206] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-8aaceb6c-6f45-4031-bad4-0c5b94c59194 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.523206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8aaceb6c-6f45-4031-bad4-0c5b94c59194" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.523206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8aaceb6c-6f45-4031-bad4-0c5b94c59194" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.523206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8aaceb6c-6f45-4031-bad4-0c5b94c59194" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.523206] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8aaceb6c-6f45-4031-bad4-0c5b94c59194',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.024642] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.024749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.027633] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8aaceb6c-6f45-4031-bad4-0c5b94c59194 with status ACTIVE [ 1148.027894] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.028056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.028144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.028426] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.028534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.028715] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.028818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.028879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.029318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.029469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.029685] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.029791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.029925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.030149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.030264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.030404] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8aaceb6c-6f45-4031-bad4-0c5b94c59194 is going to be updated. [ 1148.059727] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.059929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.060243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.060447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.060586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.060750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8aaceb6c-6f45-4031-bad4-0c5b94c59194" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.295551] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1148.295762] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 1148.295889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.296129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.296390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.296586] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.296731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.296807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.296984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.297087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.297209] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.671287] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1148.671605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.768517] env[65553]: INFO networking_nsxv3.common.synchronization [None req-d0a7f7cb-e7a0-46ec-ac23-ce0cdcfa338c None None] Enqueued Resource ID: 6398fcd6-ee16-4e7a-af3c-74ea2d3c63ca with Priority: HIGHEST for action port [ 1148.769153] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6398fcd6-ee16-4e7a-af3c-74ea2d3c63ca with Priority: HIGHEST for action port [ 1148.769522] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-6398fcd6-ee16-4e7a-af3c-74ea2d3c63ca taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.769649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6398fcd6-ee16-4e7a-af3c-74ea2d3c63ca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.769745] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6398fcd6-ee16-4e7a-af3c-74ea2d3c63ca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.770433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6398fcd6-ee16-4e7a-af3c-74ea2d3c63ca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.770433] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6398fcd6-ee16-4e7a-af3c-74ea2d3c63ca',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.799509] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.272411] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6398fcd6-ee16-4e7a-af3c-74ea2d3c63ca [ 1149.272732] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.273073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.273073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.273195] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.273425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.273425] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6398fcd6-ee16-4e7a-af3c-74ea2d3c63ca already deleted. [ 1149.273425] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6398fcd6-ee16-4e7a-af3c-74ea2d3c63ca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.301636] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.448388] env[65553]: INFO networking_nsxv3.common.synchronization [req-3923db58-b58c-4592-b7f5-1a8ece4f9e5c req-5b158508-53a1-4f06-9649-167a2bb5f0e4 tempest-ServersTestMultiNic-1539507516 tempest-ServersTestMultiNic-1539507516-project-member] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1149.448388] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1149.448388] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.448388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.448388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.449630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.449630] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.449630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.449630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.449630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.449630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.449915] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.687985] env[65553]: INFO networking_nsxv3.common.synchronization [req-3923db58-b58c-4592-b7f5-1a8ece4f9e5c req-715f5a1e-91bf-4e2a-b5a4-c1bb71c0f40a tempest-ServersTestMultiNic-1539507516 tempest-ServersTestMultiNic-1539507516-project-member] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1149.688516] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1149.688860] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.689370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.804912] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.805149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.805211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.805520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.806032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.806032] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1149.836713] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.836966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.837135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.837475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.837719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.847890] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1149.930847] env[65553]: INFO networking_nsxv3.common.synchronization [req-3923db58-b58c-4592-b7f5-1a8ece4f9e5c req-dcf3b400-e768-4a64-af5b-e5883e48b54d tempest-ServersTestMultiNic-1539507516 tempest-ServersTestMultiNic-1539507516-project-member] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1149.931470] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1149.932048] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.932048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.952768] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.455167] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.959581] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.960072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.960072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.960072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.960210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.960361] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1150.991570] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.991570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.991570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.991871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.992343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.005030] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1151.861083] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1151.861083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.861083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.861414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.861414] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.861551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.861551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.861692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.861778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.861865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.861953] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.363941] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.364390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.364390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.364390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.364568] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.364672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.364736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.364890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.364975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.365079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.365238] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.365331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.365391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.365532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.365670] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.365760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.365819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.365957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.366042] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.366124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.366236] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.869525] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9009da09-3880-4f06-b8cc-6f3ff62a7fbd: rpc.has_security_group_logging(os_id): False [ 1152.886895] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.887097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.887156] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.887462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.887548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.887753] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.887935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.887935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.888082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.888155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.888331] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.888434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.888473] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.888607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.888678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.888890] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.888960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.889025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.889165] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.889238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.889358] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1152.951404] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.951577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.951648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.951887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.952047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.974956] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1153.024145] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1153.024145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.024145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.024145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.024397] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.024451] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.024482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.024678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.024779] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.024910] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.282752] env[65553]: INFO networking_nsxv3.common.synchronization [req-e14e56a7-c139-475f-a79f-bde099fe56fa req-3414e6d7-2773-485e-bd75-3dd3862d19f0 tempest-ServerRescueNegativeTestJSON-1136890635 tempest-ServerRescueNegativeTestJSON-1136890635-project-member] Enqueued Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1153.283377] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1153.283705] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.284643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.284643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.284643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.284643] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.284643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.284643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.284919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.284919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.285119] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.528044] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.528277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.528436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.528721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.528859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.529141] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.529286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.529408] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.529737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.529737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.529849] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1153.575767] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.576025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.576025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.577295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.577508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.589251] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1153.708037] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.708037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.708037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.708037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.708717] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.709230] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.709558] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.710019] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.710400] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.710685] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1153.710812] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.710928] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.711062] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.711204] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1153.711321] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.711495] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.731889] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.732331] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1153.732331] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.732561] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.732992] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-826b9698-002d-4184-ac7f-7677959ee64f taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.733204] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-826b9698-002d-4184-ac7f-7677959ee64f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.734038] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-826b9698-002d-4184-ac7f-7677959ee64f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.734038] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-826b9698-002d-4184-ac7f-7677959ee64f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.734038] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('826b9698-002d-4184-ac7f-7677959ee64f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.788021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.788021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.788021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.788021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.788021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.788302] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.788302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.788302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.788439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.788439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.788501] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f already deleted. [ 1153.788556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.237012] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.237012] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.237012] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.237404] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.237404] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.237494] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 826b9698-002d-4184-ac7f-7677959ee64f not found, creating... [ 1154.240897] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.240897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.240897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.240897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.240897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.240897] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.240897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.240897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.240897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.240897] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.241319] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 826b9698-002d-4184-ac7f-7677959ee64f is going to be created. [ 1154.262140] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.262364] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.262485] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.262756] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.262981] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.263233] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-826b9698-002d-4184-ac7f-7677959ee64f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.991047] env[65553]: INFO networking_nsxv3.common.synchronization [req-e14e56a7-c139-475f-a79f-bde099fe56fa req-45fa17da-427c-4957-b72d-625b83a2ede4 service nova] Enqueued Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_rules [ 1154.991299] env[65553]: INFO networking_nsxv3.common.synchronization [req-e14e56a7-c139-475f-a79f-bde099fe56fa req-45fa17da-427c-4957-b72d-625b83a2ede4 service nova] Enqueued Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1154.991503] env[65553]: INFO networking_nsxv3.common.synchronization [req-e14e56a7-c139-475f-a79f-bde099fe56fa req-45fa17da-427c-4957-b72d-625b83a2ede4 service nova] Enqueued Resource ID: 826b9698-002d-4184-ac7f-7677959ee64f with Priority: HIGHEST for action port [ 1154.992537] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1154.992816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.993432] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_rules [ 1154.993631] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1154.993683] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826b9698-002d-4184-ac7f-7677959ee64f with Priority: HIGHEST for action port [ 1154.993933] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.994066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.994154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.994457] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.994546] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.995481] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.995616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.995691] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.995880] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.996317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.996317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.996317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.996480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.997280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.998288] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.999330] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-826b9698-002d-4184-ac7f-7677959ee64f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.999330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-826b9698-002d-4184-ac7f-7677959ee64f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.999330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-826b9698-002d-4184-ac7f-7677959ee64f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.999330] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-826b9698-002d-4184-ac7f-7677959ee64f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.999330] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('826b9698-002d-4184-ac7f-7677959ee64f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.500879] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.501084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.501333] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.503965] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 826b9698-002d-4184-ac7f-7677959ee64f with status ACTIVE [ 1155.503965] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.504584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.504679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.505035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.505119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.505333] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.506317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.506317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.506317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.506317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.506317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.506317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.506317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.506868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.506868] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.506868] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 826b9698-002d-4184-ac7f-7677959ee64f is going to be updated. [ 1155.548056] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.548276] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.548329] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.548609] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.549545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.549545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-826b9698-002d-4184-ac7f-7677959ee64f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.601860] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1155.602103] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 deletion is rescheduled due to dependency. [ 1155.602239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.602439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.602637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.602824] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.602979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.603050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.603175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.603256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.603353] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.752267] env[65553]: INFO networking_nsxv3.common.synchronization [req-2a984feb-5335-4e02-8f20-fbf669eae41a req-299e76ce-dde0-4eaf-8709-8cacb2b30966 tempest-ServerRescueNegativeTestJSON-1136890635 tempest-ServerRescueNegativeTestJSON-1136890635-project-member] Enqueued Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1155.752930] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1155.753419] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.753554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.009937] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.109527] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.109527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.109527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.109527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.109527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.109527] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.109527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.109527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.109527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.109527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.109527] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1156.122791] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.122791] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.128347] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.128347] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.128347] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.128347] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.128347] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.129828] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.129828] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.129828] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.129828] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.129828] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.129828] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.130700] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.131013] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.131682] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.139048] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.139048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.139048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.139048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.139048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.151922] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1156.161025] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.161025] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1156.161025] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.161025] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.161025] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-32cb369d-98f2-41bd-afb8-8d7da7bb54fd taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.161025] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-32cb369d-98f2-41bd-afb8-8d7da7bb54fd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.161025] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-32cb369d-98f2-41bd-afb8-8d7da7bb54fd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.161025] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-32cb369d-98f2-41bd-afb8-8d7da7bb54fd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.161025] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32cb369d-98f2-41bd-afb8-8d7da7bb54fd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.514428] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.514635] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.514698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.514864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.514957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.515094] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f is going to be created. [ 1156.541454] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.541454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.541677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.541712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.541862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.552310] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: UNINITIALIZED for 2s [ 1156.665099] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.666009] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.666202] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.666493] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.666644] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.666800] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 32cb369d-98f2-41bd-afb8-8d7da7bb54fd not found, creating... [ 1156.667090] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.667257] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.667374] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.667622] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.667759] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.670554] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.670868] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.671082] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.671312] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.671639] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.671738] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 32cb369d-98f2-41bd-afb8-8d7da7bb54fd is going to be created. [ 1156.694198] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.694664] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.694778] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.695169] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.695492] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.695815] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-32cb369d-98f2-41bd-afb8-8d7da7bb54fd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.824936] env[65553]: INFO networking_nsxv3.common.synchronization [req-db578d8f-0ceb-4a1f-abdb-9a737750454c req-10dcdb1a-0dd6-4723-9c9f-154fed9a4178 tempest-ServerActionsTestOtherA-986912121 tempest-ServerActionsTestOtherA-986912121-project-member] Enqueued Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 1156.825512] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 with Priority: HIGHEST for action security_group_members [ 1156.825895] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.826087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.826166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.826376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.826533] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.826634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.826696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.826843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.826958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.827082] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75ff2ed9-6e49-4d62-a3e7-345569ebb0f7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.329440] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.329786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.329786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.329921] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.329993] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.330214] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.330321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.330388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.330577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.330673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.330776] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 is going to be updated. [ 1157.371170] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.371355] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.371398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.371580] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.371771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.381977] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: IN_PROGRESS for 2s [ 1157.408223] env[65553]: INFO networking_nsxv3.common.synchronization [req-2a984feb-5335-4e02-8f20-fbf669eae41a req-fe6d7168-65ad-46b7-8ff6-7f47bf892331 service nova] Enqueued Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_rules [ 1157.408539] env[65553]: INFO networking_nsxv3.common.synchronization [req-2a984feb-5335-4e02-8f20-fbf669eae41a req-fe6d7168-65ad-46b7-8ff6-7f47bf892331 service nova] Enqueued Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1157.408775] env[65553]: INFO networking_nsxv3.common.synchronization [req-2a984feb-5335-4e02-8f20-fbf669eae41a req-fe6d7168-65ad-46b7-8ff6-7f47bf892331 service nova] Enqueued Resource ID: 32cb369d-98f2-41bd-afb8-8d7da7bb54fd with Priority: HIGHEST for action port [ 1157.409636] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_rules [ 1157.409834] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1157.409952] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32cb369d-98f2-41bd-afb8-8d7da7bb54fd with Priority: HIGHEST for action port [ 1157.410505] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.410634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.410847] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.410990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.411371] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-32cb369d-98f2-41bd-afb8-8d7da7bb54fd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.411465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32cb369d-98f2-41bd-afb8-8d7da7bb54fd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.411579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32cb369d-98f2-41bd-afb8-8d7da7bb54fd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.411954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32cb369d-98f2-41bd-afb8-8d7da7bb54fd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.411954] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32cb369d-98f2-41bd-afb8-8d7da7bb54fd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.917021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32cb369d-98f2-41bd-afb8-8d7da7bb54fd with status ACTIVE [ 1157.917021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.917021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.917021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.917021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.917021] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32cb369d-98f2-41bd-afb8-8d7da7bb54fd is going to be updated. [ 1157.941895] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.941895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.941895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.941895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.941895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.941895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32cb369d-98f2-41bd-afb8-8d7da7bb54fd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.162991] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1158.163243] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 deletion is rescheduled due to dependency. [ 1158.163376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.564717] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: SUCCESS [ 1158.565016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.565243] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.565511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.565811] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.566043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.566151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.566389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.566519] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.566660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.566808] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.568073] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.568323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.568579] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.568752] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.568864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.569048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.569944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.569944] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.072220] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.072376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.072620] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.393517] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 in Status: SUCCESS [ 1159.393697] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75ff2ed9-6e49-4d62-a3e7-345569ebb0f7 deletion is rescheduled due to dependency. [ 1159.393697] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75ff2ed9-6e49-4d62-a3e7-345569ebb0f7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.477965] env[65553]: INFO networking_nsxv3.common.synchronization [req-44e5b9c1-2009-46b8-b89d-a07377cd07c5 req-49afaffc-1ddb-443c-a33e-ba99cea9844e tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1159.478611] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1159.478975] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.479116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.479356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.479494] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.479667] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.479774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.479834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.479994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.480101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.480222] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.575431] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.982873] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.983104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.983104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.983312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.983412] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.983607] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.983742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.983807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.983957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.984033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.984126] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1160.013335] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.013595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.013675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.013892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.014051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.024225] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1160.079273] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.079273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.079273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.080550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.080630] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.081146] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f is going to be updated. [ 1160.117632] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.117822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.118669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.118940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.119113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.131259] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: IN_PROGRESS for 2s [ 1162.036156] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1162.036548] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 1162.036548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.143487] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: SUCCESS [ 1162.143487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.143487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.143487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.143487] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.143487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.143487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.143487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.143487] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.143487] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.645499] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.150121] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.652898] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.652898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.652898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.653503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.653503] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.653503] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f is going to be updated. [ 1163.685968] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.686155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.686219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.686447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.686602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.697242] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: IN_PROGRESS for 2s [ 1164.479612] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1164.479926] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1165.485896] env[65553]: INFO networking_nsxv3.common.synchronization [req-569a7df7-3d5d-4462-990d-2ee20ecf7054 req-f3bfb1c8-a5ca-4a7e-907c-48d1ca13219d tempest-ServersTestMultiNic-1539507516 tempest-ServersTestMultiNic-1539507516-project-member] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1165.486286] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1165.486603] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.486929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.486929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.487058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.488210] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.488210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.488210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.488210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.488210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.488210] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.711171] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: SUCCESS [ 1165.712131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.712131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.712348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.712961] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.713422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.713541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.713904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.714391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.714569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.715213] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.716250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.716326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.717861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.718384] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.718506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.718590] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.719333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.719411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.719538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.719652] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.992500] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.992711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.992768] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.993054] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.993157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.993291] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.993390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.993495] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.993641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.993845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.993845] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1166.021438] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.021736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.021736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.021956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.022144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.031858] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1166.060660] env[65553]: INFO networking_nsxv3.common.synchronization [req-569a7df7-3d5d-4462-990d-2ee20ecf7054 req-1ab8e537-631f-47b2-9f82-9faea94dbca2 tempest-ServersTestMultiNic-1539507516 tempest-ServersTestMultiNic-1539507516-project-member] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1166.061295] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1166.062128] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.062234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.223391] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f: rpc.has_security_group_logging(os_id): False [ 1166.245040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.245040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.245040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.245040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.245340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.245372] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.246435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.246435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.246435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.246435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.246435] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.246435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.246435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.246435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.246718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.246718] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.246718] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.246832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.246969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.247023] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.247136] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f is going to be created. [ 1166.328430] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.328623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.328694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.329012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.329242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.343177] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: IN_PROGRESS for 2s [ 1166.442972] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-889 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.443182] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-889" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.443258] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-889" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.443598] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-889" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.443875] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.444051] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.444171] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.444419] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.444535] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.444791] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1166.444914] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1166.445035] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1166.445146] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1166.445256] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1166.445745] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1166.445745] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1166.467649] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1166.467830] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1166.467973] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1166.468186] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-889" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.468580] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-08cfab0e-965a-4c21-b510-f4ccc3138b78 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.468795] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-08cfab0e-965a-4c21-b510-f4ccc3138b78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.468911] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-08cfab0e-965a-4c21-b510-f4ccc3138b78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.469915] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-08cfab0e-965a-4c21-b510-f4ccc3138b78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.469915] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08cfab0e-965a-4c21-b510-f4ccc3138b78',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.973338] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.973751] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.973751] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.974083] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.974199] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.974357] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 08cfab0e-965a-4c21-b510-f4ccc3138b78 not found, creating... [ 1166.974640] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.974814] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.974930] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.975179] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.975315] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.975609] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.975803] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.975905] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.976148] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.976285] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.976423] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 08cfab0e-965a-4c21-b510-f4ccc3138b78 is going to be created. [ 1166.997703] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.997895] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.998035] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.998326] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.998580] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.998805] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-08cfab0e-965a-4c21-b510-f4ccc3138b78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.732408] env[65553]: INFO networking_nsxv3.common.synchronization [req-569a7df7-3d5d-4462-990d-2ee20ecf7054 req-ca17914d-5bb1-46a3-a65f-6f2728db17c0 service nova] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_rules [ 1167.732503] env[65553]: INFO networking_nsxv3.common.synchronization [req-569a7df7-3d5d-4462-990d-2ee20ecf7054 req-ca17914d-5bb1-46a3-a65f-6f2728db17c0 service nova] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1167.732634] env[65553]: INFO networking_nsxv3.common.synchronization [req-569a7df7-3d5d-4462-990d-2ee20ecf7054 req-ca17914d-5bb1-46a3-a65f-6f2728db17c0 service nova] Enqueued Resource ID: 08cfab0e-965a-4c21-b510-f4ccc3138b78 with Priority: HIGHEST for action port [ 1167.733351] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_rules [ 1167.733507] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1167.733603] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08cfab0e-965a-4c21-b510-f4ccc3138b78 with Priority: HIGHEST for action port [ 1167.733890] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.735349] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.735441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.735614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.735698] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.736754] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.736853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.737086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-08cfab0e-965a-4c21-b510-f4ccc3138b78 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.737203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08cfab0e-965a-4c21-b510-f4ccc3138b78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.737263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08cfab0e-965a-4c21-b510-f4ccc3138b78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.737443] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08cfab0e-965a-4c21-b510-f4ccc3138b78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.737519] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08cfab0e-965a-4c21-b510-f4ccc3138b78',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.046474] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1168.046861] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 deletion is rescheduled due to dependency. [ 1168.047647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.047647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.047647] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.048417] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.048659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.048748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.048928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.049022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.049122] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.239615] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.239795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.239942] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08cfab0e-965a-4c21-b510-f4ccc3138b78 with status ACTIVE [ 1168.240138] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.240244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.240304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.240537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.240675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.240843] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.240939] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.240992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.241183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.241249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.241544] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.241544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.241706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.241706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.241891] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.241891] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08cfab0e-965a-4c21-b510-f4ccc3138b78 is going to be updated. [ 1168.267415] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.267655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.267719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.267979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.268152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.268447] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08cfab0e-965a-4c21-b510-f4ccc3138b78" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.359122] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: SUCCESS [ 1168.359382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.359584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.359807] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.359900] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.539897] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-132 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.540084] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-132" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.540212] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-132" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.540578] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-132" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.541028] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.541151] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.541151] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.541449] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.541533] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.541745] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.541860] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.541977] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.542094] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.542203] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.542305] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.542433] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.552989] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.562628] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.562628] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1168.562628] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.562966] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-132" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.563220] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-72b72bb2-fc6f-4aca-beb2-d36bd0b316d0 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.563455] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-72b72bb2-fc6f-4aca-beb2-d36bd0b316d0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.563455] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-72b72bb2-fc6f-4aca-beb2-d36bd0b316d0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.563723] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-72b72bb2-fc6f-4aca-beb2-d36bd0b316d0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.563864] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72b72bb2-fc6f-4aca-beb2-d36bd0b316d0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.863633] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.863633] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.863890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.863925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.864111] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.864214] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.864272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.864413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.864501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.864591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.864680] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.054895] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.066975] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.067234] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.067396] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.067715] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.067863] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.068046] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 72b72bb2-fc6f-4aca-beb2-d36bd0b316d0 not found, creating... [ 1169.068362] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.068536] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.068679] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.068905] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.069063] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.069373] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.069586] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.069731] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.069900] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.070049] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.070198] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 72b72bb2-fc6f-4aca-beb2-d36bd0b316d0 is going to be created. [ 1169.094379] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.094813] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.094985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.095438] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.095790] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.096173] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-72b72bb2-fc6f-4aca-beb2-d36bd0b316d0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.369287] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.369476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.369520] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.369770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.370020] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.370153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.370273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.370382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.370469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.370577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.370738] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.370829] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.370888] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.371038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.371174] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.371264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.371321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.371453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.371526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.371603] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.371693] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.557794] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.557948] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.558041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.559204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.559204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.559204] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1169.591279] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.591514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.591514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.591770] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.591865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.602753] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1169.833070] env[65553]: INFO networking_nsxv3.common.synchronization [req-569a7df7-3d5d-4462-990d-2ee20ecf7054 req-966add85-4eff-49ba-800c-e6c2f67a58d6 service nova] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_rules [ 1169.833347] env[65553]: INFO networking_nsxv3.common.synchronization [req-569a7df7-3d5d-4462-990d-2ee20ecf7054 req-966add85-4eff-49ba-800c-e6c2f67a58d6 service nova] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1169.833551] env[65553]: INFO networking_nsxv3.common.synchronization [req-569a7df7-3d5d-4462-990d-2ee20ecf7054 req-966add85-4eff-49ba-800c-e6c2f67a58d6 service nova] Enqueued Resource ID: 72b72bb2-fc6f-4aca-beb2-d36bd0b316d0 with Priority: HIGHEST for action port [ 1169.834400] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_rules [ 1169.834645] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1169.834799] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b72bb2-fc6f-4aca-beb2-d36bd0b316d0 with Priority: HIGHEST for action port [ 1169.835231] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.835231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.835471] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.835578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.835839] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-72b72bb2-fc6f-4aca-beb2-d36bd0b316d0 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.835925] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72b72bb2-fc6f-4aca-beb2-d36bd0b316d0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.836046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72b72bb2-fc6f-4aca-beb2-d36bd0b316d0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.836341] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72b72bb2-fc6f-4aca-beb2-d36bd0b316d0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.836496] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72b72bb2-fc6f-4aca-beb2-d36bd0b316d0',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.874019] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f: rpc.has_security_group_logging(os_id): False [ 1169.892604] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.892604] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.892931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.893109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.893224] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.893446] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.893554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.893705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.893898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.893989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.894282] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.894387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.894464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.894800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.894938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.895168] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.895262] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.895400] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.895581] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.895661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.895750] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f is going to be updated. [ 1169.963591] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.963591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.963591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.963841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.963841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.978323] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: IN_PROGRESS for 2s [ 1170.338968] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72b72bb2-fc6f-4aca-beb2-d36bd0b316d0 with status ACTIVE [ 1170.339281] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.339362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.340052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.340052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.340052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.340052] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.340052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.340553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.340553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.340553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.340553] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.340791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.340791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.340791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.340954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.340954] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72b72bb2-fc6f-4aca-beb2-d36bd0b316d0 is going to be updated. [ 1170.378404] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.378565] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.378607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.378822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.379104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.379162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72b72bb2-fc6f-4aca-beb2-d36bd0b316d0" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.614389] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1171.614840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.614840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.615118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.615350] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.615477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.615531] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.615697] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.615778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.615876] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.992153] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: SUCCESS [ 1171.992153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.118756] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.622787] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.126736] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.126915] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.126975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.127230] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.127335] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.127457] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1173.160603] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.160780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.160841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.161121] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.161282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.173361] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1174.329845] env[65553]: INFO networking_nsxv3.common.synchronization [req-ee422d09-fb19-4126-ad20-ef1bd7a5d462 req-f7647786-6000-48bd-85a3-5a19497f792d tempest-ServerActionsTestOtherB-2131075409 tempest-ServerActionsTestOtherB-2131075409-project-member] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1174.329845] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1174.329845] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.329845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.329845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.329845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.330396] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.330396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.330396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.330396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.330572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.330676] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.833841] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.833903] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.833947] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.834212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.834320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.834541] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.834777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.834777] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.834870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.834963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.835088] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be updated. [ 1174.866729] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.866729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.866729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.866729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.866729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.876544] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1175.185293] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1175.185543] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.185689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.185917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.186125] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.186244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.186308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.186459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.186539] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.186627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.186728] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.187595] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.187788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.187949] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.188067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.188132] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.188272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.188348] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.188432] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.416651] env[65553]: INFO networking_nsxv3.common.synchronization [req-56fef7a0-1ef4-40ad-81b2-0d962f245418 req-6a93bbcc-1106-495b-a34e-6865ac0567e7 tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1175.417311] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1175.417817] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.417950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.417950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.418444] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.418444] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.418574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.418574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.418703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.418789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.419187] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.690593] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.690764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.691012] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.818829] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.819317] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.819382] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.819757] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.820197] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.820402] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.820524] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.820768] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.820924] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.821158] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.821270] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.821376] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.821510] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.821588] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.821711] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.821844] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.843235] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.843400] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1175.843536] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.843705] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-479" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.844034] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-3b0696f7-86e1-425a-ac6f-8808dad34eca taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.844208] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-3b0696f7-86e1-425a-ac6f-8808dad34eca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.844323] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-3b0696f7-86e1-425a-ac6f-8808dad34eca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.844656] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-3b0696f7-86e1-425a-ac6f-8808dad34eca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.844798] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b0696f7-86e1-425a-ac6f-8808dad34eca',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.921625] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.921829] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.921829] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.921970] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.922078] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.922277] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.922379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.922440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.922588] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.922669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.922756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1175.949387] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.949584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.949584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.949894] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.950051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.959864] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1176.195977] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.348604] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.348604] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.348604] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.348604] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.348604] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.348604] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 3b0696f7-86e1-425a-ac6f-8808dad34eca not found, creating... [ 1176.348972] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.348972] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.349062] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.349265] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.349421] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.349695] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.349857] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.349971] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.350191] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.350317] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.350452] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 3b0696f7-86e1-425a-ac6f-8808dad34eca is going to be created. [ 1176.373162] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.373384] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.373476] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.373756] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.373982] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.374227] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-3b0696f7-86e1-425a-ac6f-8808dad34eca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.700401] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.700401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.700401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.700401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.700401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.700401] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1176.738097] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.738395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.738395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.738806] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.739027] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.750265] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1176.888434] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1176.888661] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a deletion is rescheduled due to dependency. [ 1176.888790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.120703] env[65553]: INFO networking_nsxv3.common.synchronization [req-56fef7a0-1ef4-40ad-81b2-0d962f245418 req-76332138-0b16-451c-a349-55af4802c2f4 service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 1177.121875] env[65553]: INFO networking_nsxv3.common.synchronization [req-56fef7a0-1ef4-40ad-81b2-0d962f245418 req-76332138-0b16-451c-a349-55af4802c2f4 service nova] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1177.121875] env[65553]: INFO networking_nsxv3.common.synchronization [req-56fef7a0-1ef4-40ad-81b2-0d962f245418 req-76332138-0b16-451c-a349-55af4802c2f4 service nova] Enqueued Resource ID: 3b0696f7-86e1-425a-ac6f-8808dad34eca with Priority: HIGHEST for action port [ 1177.122847] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_rules [ 1177.122847] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1177.122847] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b0696f7-86e1-425a-ac6f-8808dad34eca with Priority: HIGHEST for action port [ 1177.123462] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.123676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.123818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.124890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.125218] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.126023] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.126159] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.126440] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b0696f7-86e1-425a-ac6f-8808dad34eca taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.126552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b0696f7-86e1-425a-ac6f-8808dad34eca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.126606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b0696f7-86e1-425a-ac6f-8808dad34eca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.126871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b0696f7-86e1-425a-ac6f-8808dad34eca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.126966] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b0696f7-86e1-425a-ac6f-8808dad34eca',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.633244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.633244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.633244] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b0696f7-86e1-425a-ac6f-8808dad34eca with status ACTIVE [ 1177.633244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.633244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.633244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.633244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.633244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.633244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.633244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.633244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.633244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.633244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.633244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.633680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.633680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.633680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.633680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.633680] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b0696f7-86e1-425a-ac6f-8808dad34eca is going to be updated. [ 1177.656261] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.658689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.658689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.658689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.658689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.658689] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b0696f7-86e1-425a-ac6f-8808dad34eca" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.972735] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1177.973153] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 1177.973153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.973278] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.973534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.973738] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.973874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.973931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.974150] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.974506] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.974711] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.477054] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.761052] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1178.761669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.761669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.761669] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.761889] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.761960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.762047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.762205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.762285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.762372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.762528] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.762637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.762694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.762854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.762997] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.763108] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.763167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.763302] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.763376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.763453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.763539] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.979307] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.265422] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 928f1d2f-688e-44af-b91a-cbdcb3b52d50: rpc.has_security_group_logging(os_id): False [ 1179.283942] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.284112] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.284180] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.284397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.284484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.284706] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.284815] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.284873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.285212] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.285294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.285477] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.285562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.285622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.285859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.285937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.286139] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.286239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.286296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.286432] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.286502] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.286586] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1179.349251] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.349460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.349460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.349735] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.349872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.372774] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1179.482482] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.482676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.482722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.482933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.483407] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.483407] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1179.521657] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.521840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.521877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.522145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.522246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.536691] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1181.084421] env[65553]: INFO networking_nsxv3.common.synchronization [req-abf51105-dfa9-46f7-b58e-3d94ba5755e1 req-dff88f1d-461d-44c2-bf0b-2ce3a4d8b39b tempest-ServersTestMultiNic-1539507516 tempest-ServersTestMultiNic-1539507516-project-member] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1181.085111] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1181.085584] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.085959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.085959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.086282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.086537] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.086713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.086828] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.087120] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.087305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.087442] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.297689] env[65553]: INFO networking_nsxv3.common.synchronization [req-abf51105-dfa9-46f7-b58e-3d94ba5755e1 req-fb6ee1b4-962b-4a7e-a839-36991addd8e3 tempest-ServersTestMultiNic-1539507516 tempest-ServersTestMultiNic-1539507516-project-member] Enqueued Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1181.298337] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 with Priority: HIGHEST for action security_group_members [ 1181.298658] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-928f1d2f-688e-44af-b91a-cbdcb3b52d50 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.298765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.388259] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1181.388474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.388637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.388848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.388938] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.547837] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1181.548075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.548249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.548486] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.548703] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.548857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.548969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.549218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.549336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.549505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.549603] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.590251] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.644437] env[65553]: INFO networking_nsxv3.common.synchronization [req-ea0daa45-a4ef-4cff-b2cd-f4261bad2ec4 req-b9876865-8de1-478a-8ec7-8eabee3da077 tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1181.644900] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1181.645243] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.645382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.645467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.645642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.645822] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.645929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.645994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.646177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.646263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.646358] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.920039] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.920039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.920039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.920339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.920430] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.920611] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be deleted. [ 1182.001821] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.001821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.002825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.002825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.002825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.002825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.056047] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.056047] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.056047] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.056047] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.056047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.058705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.058705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.058705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.058705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.059429] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.094246] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.134928] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.135370] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.135517] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.135806] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.136246] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.136430] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.136560] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.136824] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.136973] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.137210] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.137447] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1182.137563] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1182.137784] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1182.137909] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.138074] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1182.138215] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.149090] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.149216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.149251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.149459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.149547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.149766] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.149879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.149946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.150129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.150208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.150297] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 1182.170512] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.170687] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1182.170811] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.171089] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-731" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.171479] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-7b451c2f-954a-4a8a-8fc5-f2815d21999d taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.171697] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.171843] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.172214] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.172382] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b451c2f-954a-4a8a-8fc5-f2815d21999d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.189421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.189607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.189607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.189927] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.190133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.216960] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 1182.464601] env[65553]: INFO networking_nsxv3.common.synchronization [req-bbf6d59b-db60-4af9-81c3-49eb05ce33c7 req-d50cb086-f16c-457b-8d1f-1fd03eb04cf8 tempest-AttachVolumeNegativeTest-1863747994 tempest-AttachVolumeNegativeTest-1863747994-project-member] Enqueued Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_members [ 1182.465739] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGHEST for action security_group_members [ 1182.466190] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-45d61543-0c85-4845-bdc5-d666ed96b205 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.466471] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.466582] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.466822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.467030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.467188] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.467529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.467863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.468025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.468171] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.563771] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9009da09-3880-4f06-b8cc-6f3ff62a7fbd: rpc.has_security_group_logging(os_id): False [ 1182.584244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.584381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.584785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.584785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.584785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.584947] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.585067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.585127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.585268] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.585339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.585832] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.585832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.585832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.585832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.586075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.586075] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.586162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.586201] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.586315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.586388] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.586490] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1182.596554] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.596554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.596554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.596784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.596821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.596947] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be updated. [ 1182.624166] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.624310] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.624377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.624586] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.624722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.634812] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: IN_PROGRESS for 2s [ 1182.653110] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.653294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.653342] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.653542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.653680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.674932] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1182.675706] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.676117] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.676338] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.676762] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.677016] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.677486] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.677776] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.677947] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.678291] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.678442] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.678746] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.678908] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.679032] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.679478] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.679622] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.679847] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 7b451c2f-954a-4a8a-8fc5-f2815d21999d is going to be updated. [ 1182.719685] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.722184] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.722184] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.722184] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.722184] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.722184] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.972140] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.972140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.972140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.972140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.972140] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.972396] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.972396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.972485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.972721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.972858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.972992] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d61543-0c85-4845-bdc5-d666ed96b205 is going to be updated. [ 1183.007944] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.007944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.007944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.007944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.007944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.029894] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d61543-0c85-4845-bdc5-d666ed96b205 in Status: IN_PROGRESS for 2s [ 1183.457234] env[65553]: INFO networking_nsxv3.common.synchronization [req-9c3d3306-a788-4869-a841-548132722400 req-d2f8fd03-a2b4-4b66-97bf-08e743e54bab service nova] Enqueued Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_rules [ 1183.457478] env[65553]: INFO networking_nsxv3.common.synchronization [req-9c3d3306-a788-4869-a841-548132722400 req-d2f8fd03-a2b4-4b66-97bf-08e743e54bab service nova] Enqueued Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_members [ 1183.457522] env[65553]: INFO networking_nsxv3.common.synchronization [req-9c3d3306-a788-4869-a841-548132722400 req-d2f8fd03-a2b4-4b66-97bf-08e743e54bab service nova] Enqueued Resource ID: 7b451c2f-954a-4a8a-8fc5-f2815d21999d with Priority: HIGHEST for action port [ 1183.458208] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_rules [ 1183.458350] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_members [ 1183.458451] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b451c2f-954a-4a8a-8fc5-f2815d21999d with Priority: HIGHEST for action port [ 1183.458733] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.458859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.458942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.459163] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.459247] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.460528] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.460639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.460705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.460906] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.461079] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.461176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.461234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.461375] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.461456] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.462228] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.462591] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b451c2f-954a-4a8a-8fc5-f2815d21999d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.462591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.462591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.463013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.463013] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b451c2f-954a-4a8a-8fc5-f2815d21999d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.964566] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.964786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.964978] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.965963] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b451c2f-954a-4a8a-8fc5-f2815d21999d with status ACTIVE [ 1183.967113] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.967250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.967305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.967573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.967573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.967769] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.967872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.967929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.968098] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.968156] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.968535] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.968535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.968535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.968695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.968695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.968766] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b451c2f-954a-4a8a-8fc5-f2815d21999d is going to be updated. [ 1183.992654] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.992864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.992864] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.993080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.993219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.993377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b451c2f-954a-4a8a-8fc5-f2815d21999d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.228228] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 1184.228382] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 deletion is rescheduled due to dependency. [ 1184.228557] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.470861] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.646120] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 in Status: SUCCESS [ 1184.646398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.646578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.646852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.647209] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.647319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.647319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.647499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.647672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.647739] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('928f1d2f-688e-44af-b91a-cbdcb3b52d50',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.703644] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1184.703867] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.916154] env[65553]: INFO networking_nsxv3.common.synchronization [req-d2ccd10c-1755-438e-bd5b-0f40f195544f req-85aa0cb5-e478-41da-aeb0-181958b1bf30 tempest-ServerActionsTestOtherB-2131075409 tempest-ServerActionsTestOtherB-2131075409-project-member] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1184.916154] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1184.916154] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.916899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.917067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.917384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.917645] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.917818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.917950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.918196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.918319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.918424] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.973380] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.973627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.973627] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.973847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.973949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.974068] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 is going to be updated. [ 1185.003410] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.003634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.003634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.003857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.004030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.014595] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 in Status: IN_PROGRESS for 2s [ 1185.043159] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45d61543-0c85-4845-bdc5-d666ed96b205 in Status: SUCCESS [ 1185.043355] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45d61543-0c85-4845-bdc5-d666ed96b205 deletion is rescheduled due to dependency. [ 1185.043464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.150507] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.150672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.150832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.151164] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.151297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.151584] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.151728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.151820] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.152452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.152452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.152452] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 928f1d2f-688e-44af-b91a-cbdcb3b52d50 is going to be deleted. [ 1185.184305] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.184305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.184484] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.184566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.184645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.184791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-928f1d2f-688e-44af-b91a-cbdcb3b52d50" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.241828] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.241828] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.242066] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.242301] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.242746] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.243024] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.243254] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.243733] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.244174] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.244369] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.244571] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.244769] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.244963] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.245211] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.245416] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.245676] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.267413] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.267706] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1185.267894] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.268129] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.268655] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.268872] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.268970] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.269407] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.269533] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81ae4cb2-8f27-4db1-a1cc-6af809be9a86',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.421369] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.421541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.421650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.421929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.422071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.422327] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.422476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.422562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.422991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.422991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.423106] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be updated. [ 1185.467782] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.467782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.467782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.468043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.468077] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.478872] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1185.773142] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.773363] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.773426] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.773716] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.773887] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.774072] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 not found, creating... [ 1185.774370] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.774561] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.774695] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.774951] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.775138] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.775472] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.775641] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.775760] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.775964] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.776122] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.776265] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 is going to be created. [ 1185.801234] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.801545] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.801738] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.802167] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.802466] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.802795] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.560748] env[65553]: INFO networking_nsxv3.common.synchronization [req-d2ccd10c-1755-438e-bd5b-0f40f195544f req-05e87004-5c8f-4b58-9567-f5d14427764e service nova] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 1186.561316] env[65553]: INFO networking_nsxv3.common.synchronization [req-d2ccd10c-1755-438e-bd5b-0f40f195544f req-05e87004-5c8f-4b58-9567-f5d14427764e service nova] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1186.561316] env[65553]: INFO networking_nsxv3.common.synchronization [req-d2ccd10c-1755-438e-bd5b-0f40f195544f req-05e87004-5c8f-4b58-9567-f5d14427764e service nova] Enqueued Resource ID: 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 with Priority: HIGHEST for action port [ 1186.561754] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 1186.561995] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1186.561995] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 with Priority: HIGHEST for action port [ 1186.562295] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.562416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.562491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.562684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.562763] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.564051] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.564217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.564345] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.564477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.564553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.564706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.564802] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81ae4cb2-8f27-4db1-a1cc-6af809be9a86',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.025549] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 in Status: SUCCESS [ 1187.025549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.025757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.025971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.026200] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.026338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.026448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.026599] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.026705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.026799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.026912] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.068239] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.068380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.068577] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 with status ACTIVE [ 1187.068919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.068919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.068919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.069216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.069216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.069400] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.069495] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.069553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.069704] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.069790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.070055] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.070152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.070211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.070350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.070424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.070508] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 is going to be updated. [ 1187.094379] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.094528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.094616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.094812] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.094943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.095146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.491546] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1187.491759] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a deletion is rescheduled due to dependency. [ 1187.491759] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.491871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.492379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.492573] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.492696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.492760] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.492916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.493012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.493115] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.530420] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.996671] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.034552] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1d8093c-cd24-42d6-a98f-e99ee4f38b99: rpc.has_security_group_logging(os_id): False [ 1188.054790] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.055021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.055084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.055304] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.055393] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.055690] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.055800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.055875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.056071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.056152] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.056241] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 is going to be updated. [ 1188.145190] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.145190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.145190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.145190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.145190] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.163172] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 in Status: IN_PROGRESS for 2s [ 1188.501528] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.005457] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.005798] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.005798] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.005938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.006083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.006205] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be updated. [ 1189.041172] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.041308] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.041350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.041550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.041698] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.052097] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1190.182248] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 in Status: SUCCESS [ 1190.182786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.066055] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1191.066392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.066650] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.067015] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.067314] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.067510] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.067615] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.067881] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.068025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.068185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.068314] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.563396] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1191.563802] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1191.571213] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.074063] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 015f5088-3b94-432c-9304-6fd98b4fe26a: rpc.has_security_group_logging(os_id): False [ 1192.100569] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.100839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.100966] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.101254] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.101417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.101727] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.101837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.101914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.102183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.102336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.102495] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be updated. [ 1192.168903] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.169166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.169166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.169465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.169694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.182993] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1193.180921] env[65553]: INFO networking_nsxv3.common.synchronization [req-0f1224b2-308d-465f-ad5f-d6324bd66ae7 req-0f24d435-67c1-4449-9e15-39471a1ab331 tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1193.181539] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1193.181865] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.181987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.182062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.182300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.182466] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.182589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.182625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.182783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.182869] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.182959] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.535699] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.535896] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.536026] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.536335] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.536546] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.536695] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.536806] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.537022] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.537163] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.537366] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.537474] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.537911] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.538070] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.538189] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.538304] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.538436] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.559134] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.559304] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1193.559442] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.559614] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-692" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.559964] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-e57ce7f1-10d2-48ab-a964-30e2a31b7a48 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.560158] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-e57ce7f1-10d2-48ab-a964-30e2a31b7a48" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.560273] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-e57ce7f1-10d2-48ab-a964-30e2a31b7a48" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.560606] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-e57ce7f1-10d2-48ab-a964-30e2a31b7a48" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.560744] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e57ce7f1-10d2-48ab-a964-30e2a31b7a48',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.678295] env[65553]: INFO networking_nsxv3.common.synchronization [None req-20ca90fd-425c-4f46-8e11-486271c091f2 tempest-ServerRescueNegativeTestJSON-1136890635 tempest-ServerRescueNegativeTestJSON-1136890635-project-member] Enqueued Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_rules [ 1193.678295] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_rules [ 1193.678295] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.678295] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.678709] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.679361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.679602] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.686174] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.686174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.686174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.686174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.686174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.686174] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.686174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.686174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.686174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.686174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.686174] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 1193.719233] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.719392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.719453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.719744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.720050] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.737344] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 1193.860682] env[65553]: INFO networking_nsxv3.common.synchronization [None req-cd2fe68e-ad1c-4e65-8d20-a062bf8f847b tempest-ServerRescueNegativeTestJSON-1136890635 tempest-ServerRescueNegativeTestJSON-1136890635-project-member] Enqueued Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_rules [ 1193.861625] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_rules [ 1193.861933] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.862083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.065068] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.065389] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.065549] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.065976] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.066242] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.066511] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port e57ce7f1-10d2-48ab-a964-30e2a31b7a48 not found, creating... [ 1194.066981] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.067254] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.067449] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.067925] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.068128] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.068522] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.068934] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.069078] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.069330] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.070118] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.070185] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: e57ce7f1-10d2-48ab-a964-30e2a31b7a48 is going to be created. [ 1194.098609] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.098754] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.098796] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.099152] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.099434] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.099756] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-e57ce7f1-10d2-48ab-a964-30e2a31b7a48" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.209180] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1194.210214] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.215533] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.215716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.215845] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.216111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.216893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.216893] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 already deleted. [ 1194.216893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.217213] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.217490] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.217569] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.749563] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.749862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.750028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.750211] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.750316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.750453] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 already deleted. [ 1194.750555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.870965] env[65553]: INFO networking_nsxv3.common.synchronization [req-0f1224b2-308d-465f-ad5f-d6324bd66ae7 req-0e3b0b4b-83a5-4b71-a6d8-27d5c81325ae service nova] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_rules [ 1194.871223] env[65553]: INFO networking_nsxv3.common.synchronization [req-0f1224b2-308d-465f-ad5f-d6324bd66ae7 req-0e3b0b4b-83a5-4b71-a6d8-27d5c81325ae service nova] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1194.871322] env[65553]: INFO networking_nsxv3.common.synchronization [req-0f1224b2-308d-465f-ad5f-d6324bd66ae7 req-0e3b0b4b-83a5-4b71-a6d8-27d5c81325ae service nova] Enqueued Resource ID: e57ce7f1-10d2-48ab-a964-30e2a31b7a48 with Priority: HIGHEST for action port [ 1194.871913] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_rules [ 1194.872286] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1194.872430] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e57ce7f1-10d2-48ab-a964-30e2a31b7a48 with Priority: HIGHEST for action port [ 1194.872763] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.872892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.872960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.873191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.873264] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.874239] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.874351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.874571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e57ce7f1-10d2-48ab-a964-30e2a31b7a48 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.874643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e57ce7f1-10d2-48ab-a964-30e2a31b7a48" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.874684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e57ce7f1-10d2-48ab-a964-30e2a31b7a48" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.874858] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e57ce7f1-10d2-48ab-a964-30e2a31b7a48" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.874934] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e57ce7f1-10d2-48ab-a964-30e2a31b7a48',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.378039] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.378039] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.378696] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e57ce7f1-10d2-48ab-a964-30e2a31b7a48 with status ACTIVE [ 1195.378696] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.378696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.378696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.378914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.378914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.379038] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.379208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.379279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.379450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.379687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.379749] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.379813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.379960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.380067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.380155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.380206] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e57ce7f1-10d2-48ab-a964-30e2a31b7a48 is going to be updated. [ 1195.410625] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.410848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.410950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.411256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.411397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.411570] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e57ce7f1-10d2-48ab-a964-30e2a31b7a48" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.755074] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 1195.755285] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 deletion is rescheduled due to dependency. [ 1195.755423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.755641] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.755900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.756117] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.756244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.756307] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.756542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.756661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.756815] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.259622] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.762289] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.264988] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.265297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.265297] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.265535] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.265682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.265752] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 1197.296084] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.296084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.296084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.296084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.296418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.306636] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 1199.321261] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 1199.321261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.321534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.321626] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.321824] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.321943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.322016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.322178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.322261] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.322376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.322425] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.825217] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.873561] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1199.873767] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1199.981982] env[65553]: INFO networking_nsxv3.common.synchronization [req-f8a2f665-f55c-436a-a6e3-950b98ac8253 req-79605cb5-7860-4496-b179-bf4dbe05c9a5 tempest-ServerRescueNegativeTestJSON-1136890635 tempest-ServerRescueNegativeTestJSON-1136890635-project-member] Enqueued Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_members [ 1199.983209] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_members [ 1199.983907] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.983907] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.984107] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.984474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.984764] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.984981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.985118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.985393] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.985526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.985692] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.327698] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1246751-d3c4-4099-b16f-aa9fe0e1b1a6: rpc.has_security_group_logging(os_id): False [ 1200.348671] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.348939] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.349195] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.349493] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.349830] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.350221] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.350409] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.350724] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.350922] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.351251] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1200.351409] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.351556] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.351703] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.351855] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1200.352040] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.352204] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.354494] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.354649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.354757] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.354982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.355129] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.355446] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.355579] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.355653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.355835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.355935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.356060] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 1200.377148] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.377361] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1200.377467] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.377671] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-188" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.377998] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.378225] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.378349] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.378686] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.378823] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.421983] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.422264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.422311] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.422550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.422736] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.441572] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 1200.489431] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.489717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.489717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.490028] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.490172] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.490415] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.490548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.490614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.490763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.490849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.490922] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 already deleted. [ 1200.490996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.881563] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.881783] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.881894] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.882210] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.882387] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.882544] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313 not found, creating... [ 1200.882814] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.882975] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.883105] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.883336] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.883473] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.883757] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.883909] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.884033] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.884242] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.884372] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.884511] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313 is going to be created. [ 1200.907683] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.907906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.908021] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.908297] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.908651] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.908944] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.642629] env[65553]: INFO networking_nsxv3.common.synchronization [req-f8a2f665-f55c-436a-a6e3-950b98ac8253 req-83c866f3-18a9-43e2-847c-09b23b2e6984 service nova] Enqueued Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_rules [ 1201.642909] env[65553]: INFO networking_nsxv3.common.synchronization [req-f8a2f665-f55c-436a-a6e3-950b98ac8253 req-83c866f3-18a9-43e2-847c-09b23b2e6984 service nova] Enqueued Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_members [ 1201.642966] env[65553]: INFO networking_nsxv3.common.synchronization [req-f8a2f665-f55c-436a-a6e3-950b98ac8253 req-83c866f3-18a9-43e2-847c-09b23b2e6984 service nova] Enqueued Resource ID: 9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313 with Priority: HIGHEST for action port [ 1201.643483] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_rules [ 1201.643629] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_members [ 1201.643727] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313 with Priority: HIGHEST for action port [ 1201.644013] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.644279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.644350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.644553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.644692] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.645931] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.646051] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.646130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.646270] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.646608] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.646608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.646697] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.646823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.647537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.647537] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.649647] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.649750] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.649799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.649932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.650065] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.146863] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.147030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.152460] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313 with status ACTIVE [ 1202.154207] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.154207] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.154207] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.154207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.154924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.154924] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313 is going to be updated. [ 1202.155514] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.178685] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.178898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.178968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.179162] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.179328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.179542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d3e8e5e-b4ab-4ce0-8d43-f6ad2e210313" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.458109] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 1202.458411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.658925] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.161297] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.161455] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.161534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.161755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.161835] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.161934] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 is going to be created. [ 1203.187856] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.188101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.188235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.188783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.188783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.199315] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 in Status: UNINITIALIZED for 2s [ 1205.211065] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 in Status: SUCCESS [ 1205.211065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.211065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.211475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.211475] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.211648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.211764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.211995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.212114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.212251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.212382] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.714895] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.217473] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8: rpc.has_security_group_logging(os_id): False [ 1206.238419] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.238648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.238648] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.238865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.238942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.239481] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.239655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.239655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.239832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.239914] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.239995] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 is going to be created. [ 1206.310317] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.310436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.310576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.310840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.311125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.326017] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 in Status: IN_PROGRESS for 2s [ 1206.644611] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1206.644611] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1208.342724] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 in Status: SUCCESS [ 1208.343093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.645887] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1211.646203] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1214.695802] env[65553]: INFO networking_nsxv3.common.synchronization [req-235f7bdc-f9dd-48e6-bceb-a2cb0d4626c8 req-eeb3bbf6-ba42-4714-9f75-65d88e965908 tempest-AttachVolumeTestJSON-579631701 tempest-AttachVolumeTestJSON-579631701-project-member] Enqueued Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_members [ 1214.696622] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGHEST for action security_group_members [ 1214.696919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-537bc2bc-cdf2-4458-b7d2-e407a1378139 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.697109] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.697242] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.697414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.697575] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.697676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.697732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.697883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.697988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.698053] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.200862] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.201084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.201207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.201379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.201477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.201675] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.201784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.201838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.201982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.202070] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.202157] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 is going to be updated. [ 1215.231569] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.231798] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.231798] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.231975] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.232126] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.243150] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 in Status: IN_PROGRESS for 2s [ 1216.226687] env[65553]: INFO networking_nsxv3.common.synchronization [req-084bb36f-b375-496c-8c4e-5aed2a18a613 req-1571bfa5-329f-47e4-a085-db866f09cc00 tempest-DeleteServersTestJSON-985955975 tempest-DeleteServersTestJSON-985955975-project-member] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1216.227250] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGHEST for action security_group_members [ 1216.227544] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.227657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.227721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.227913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.228219] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.228334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.228396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.228555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.228638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.228728] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.730939] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.731135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.731208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.731434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.731523] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.731730] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.731832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.731918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.732062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.732137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.732231] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be updated. [ 1216.762900] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.763058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.763111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.763406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.763548] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.774426] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: IN_PROGRESS for 2s [ 1217.256024] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 in Status: SUCCESS [ 1217.256024] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 deletion is rescheduled due to dependency. [ 1217.256356] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.784072] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd in Status: SUCCESS [ 1218.784477] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd deletion is rescheduled due to dependency. [ 1218.784477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.228450] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.228701] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1225.217493] env[65553]: INFO networking_nsxv3.common.synchronization [None req-b95f7d03-1950-4b5b-91f8-ac3edbc7077e None None] Enqueued Resource ID: f268324f-b382-488e-a1b9-0cfd9ae0ed4d with Priority: HIGHEST for action port [ 1225.217493] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f268324f-b382-488e-a1b9-0cfd9ae0ed4d with Priority: HIGHEST for action port [ 1225.218082] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-f268324f-b382-488e-a1b9-0cfd9ae0ed4d taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.219583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f268324f-b382-488e-a1b9-0cfd9ae0ed4d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.219583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f268324f-b382-488e-a1b9-0cfd9ae0ed4d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.219583] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f268324f-b382-488e-a1b9-0cfd9ae0ed4d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.219583] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f268324f-b382-488e-a1b9-0cfd9ae0ed4d',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.721794] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f268324f-b382-488e-a1b9-0cfd9ae0ed4d [ 1225.721794] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.721955] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.722314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.722518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.722654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.722731] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f268324f-b382-488e-a1b9-0cfd9ae0ed4d already deleted. [ 1225.722837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f268324f-b382-488e-a1b9-0cfd9ae0ed4d" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.453109] env[65553]: INFO networking_nsxv3.common.synchronization [None req-4960df36-f056-4f0d-8d41-c7c5599c5d96 None None] Enqueued Resource ID: 70026cdd-dbe1-4e03-bae2-c0750bd74714 with Priority: HIGHEST for action port [ 1227.453674] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70026cdd-dbe1-4e03-bae2-c0750bd74714 with Priority: HIGHEST for action port [ 1227.453988] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-70026cdd-dbe1-4e03-bae2-c0750bd74714 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.454103] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70026cdd-dbe1-4e03-bae2-c0750bd74714" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.454187] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70026cdd-dbe1-4e03-bae2-c0750bd74714" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.454475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70026cdd-dbe1-4e03-bae2-c0750bd74714" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.454565] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70026cdd-dbe1-4e03-bae2-c0750bd74714',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.956423] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70026cdd-dbe1-4e03-bae2-c0750bd74714 [ 1227.956677] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.956773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.956857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.957065] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.957153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.957249] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70026cdd-dbe1-4e03-bae2-c0750bd74714 already deleted. [ 1227.957328] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70026cdd-dbe1-4e03-bae2-c0750bd74714" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.812556] env[65553]: INFO networking_nsxv3.common.synchronization [req-3db63bb3-d9fc-4ff5-b35f-c61c021240bd req-36fb4660-9692-4ca2-8001-399935f34179 tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1230.813119] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1230.813458] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.813603] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.813683] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.813918] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.814076] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.814177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.814249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.814381] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.814463] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.814554] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.114445] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.114445] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.114619] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.114871] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.115136] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.115293] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.115406] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.115620] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.115756] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.115968] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1231.116089] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1231.116196] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1231.116300] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1231.116409] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1231.116513] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1231.116639] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1231.137501] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1231.137671] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1231.137797] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1231.137973] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.138312] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-5d00b7b8-f4ad-4edc-9fe3-f549953da062 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.138571] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-5d00b7b8-f4ad-4edc-9fe3-f549953da062" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.138717] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-5d00b7b8-f4ad-4edc-9fe3-f549953da062" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.139055] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-5d00b7b8-f4ad-4edc-9fe3-f549953da062" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.139198] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d00b7b8-f4ad-4edc-9fe3-f549953da062',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.316730] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.316949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.316949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.317157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.317252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.317449] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.317564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.317622] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.317762] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.317838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.317920] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a already deleted. [ 1231.317998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.641200] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.641509] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.641650] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.641921] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.642086] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.642239] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 5d00b7b8-f4ad-4edc-9fe3-f549953da062 not found, creating... [ 1231.642495] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.642908] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.642908] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.643017] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.643100] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.643371] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.643522] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.643634] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.643832] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.643960] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.644610] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 5d00b7b8-f4ad-4edc-9fe3-f549953da062 is going to be created. [ 1231.665368] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.665553] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.665675] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.665961] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.666228] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.666465] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-5d00b7b8-f4ad-4edc-9fe3-f549953da062" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.340998] env[65553]: INFO networking_nsxv3.common.synchronization [req-3db63bb3-d9fc-4ff5-b35f-c61c021240bd req-1b1a2ffe-cb69-4d5a-a53a-381465658f9d service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1232.341305] env[65553]: INFO networking_nsxv3.common.synchronization [req-3db63bb3-d9fc-4ff5-b35f-c61c021240bd req-1b1a2ffe-cb69-4d5a-a53a-381465658f9d service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1232.341351] env[65553]: INFO networking_nsxv3.common.synchronization [req-3db63bb3-d9fc-4ff5-b35f-c61c021240bd req-1b1a2ffe-cb69-4d5a-a53a-381465658f9d service nova] Enqueued Resource ID: 5d00b7b8-f4ad-4edc-9fe3-f549953da062 with Priority: HIGHEST for action port [ 1232.341904] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1232.342152] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1232.342322] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d00b7b8-f4ad-4edc-9fe3-f549953da062 with Priority: HIGHEST for action port [ 1232.342662] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.342872] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.342964] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.343256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.343367] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.344235] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.344376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.344464] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.344654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.344900] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.344985] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.345035] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.345191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.345274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.345395] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.346117] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d00b7b8-f4ad-4edc-9fe3-f549953da062 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.346249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d00b7b8-f4ad-4edc-9fe3-f549953da062" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.346338] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d00b7b8-f4ad-4edc-9fe3-f549953da062" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.346514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d00b7b8-f4ad-4edc-9fe3-f549953da062" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.346613] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d00b7b8-f4ad-4edc-9fe3-f549953da062',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.848879] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.849025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.849219] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.850105] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d00b7b8-f4ad-4edc-9fe3-f549953da062 with status ACTIVE [ 1232.850284] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.850452] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.850530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.850713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.850795] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.850964] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.851071] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.851135] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.851275] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.851367] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.851540] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.851632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.851692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.851832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.851902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.851982] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d00b7b8-f4ad-4edc-9fe3-f549953da062 is going to be updated. [ 1232.874642] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.874856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.874856] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.875087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.875219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.875371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d00b7b8-f4ad-4edc-9fe3-f549953da062" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.353738] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.856659] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.856747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.856859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.857084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.857143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.857245] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be created. [ 1233.882104] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.882315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.882315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.882538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.882708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.895138] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: UNINITIALIZED for 2s [ 1235.905956] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1235.906333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.906475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.906693] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.906876] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.906989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.907066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.907214] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.907291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.907373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.907462] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.410495] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.410748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.410876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.411273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.411571] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.411717] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.411776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.411933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.412075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.412233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.412442] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.412553] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.412603] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.412755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.412912] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.413044] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.413114] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.413248] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.413369] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.413514] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.413658] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.916573] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f1bcf27-527e-4011-8166-1643df6e3b9a: rpc.has_security_group_logging(os_id): False [ 1236.938928] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.939183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.939183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.939396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.939489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.939709] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.939811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.939873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.940048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.940128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.940306] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.940401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.940496] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.940657] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.940734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.940924] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.941032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.941094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.941235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.941315] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.941462] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be created. [ 1237.029450] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.029703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.029703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.029949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.030318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.055696] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1237.343653] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1237.343850] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1238.255448] env[65553]: INFO networking_nsxv3.common.synchronization [req-f4104316-68f3-4864-a278-3d6a8800adaf req-d3fee2c0-9dad-48bf-8e7a-4aea0c1d4577 tempest-AttachVolumeShelveTestJSON-653256025 tempest-AttachVolumeShelveTestJSON-653256025-project-member] Enqueued Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_members [ 1238.255448] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 with Priority: HIGHEST for action security_group_members [ 1238.255753] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.255882] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.255942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.256208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.256370] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.256474] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.256809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.256809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.256809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.256992] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1d8093c-cd24-42d6-a98f-e99ee4f38b99',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.759410] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.759646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.759723] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.759954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.760062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.760293] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.760396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.760505] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.760683] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.760769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.760861] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 is going to be updated. [ 1238.816707] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.816939] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.816986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.817231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.817370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.833054] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 in Status: IN_PROGRESS for 2s [ 1239.068014] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1239.068268] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.843104] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 in Status: SUCCESS [ 1240.843443] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1d8093c-cd24-42d6-a98f-e99ee4f38b99 deletion is rescheduled due to dependency. [ 1240.843443] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1d8093c-cd24-42d6-a98f-e99ee4f38b99" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.257083] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1243.257525] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1246.100332] env[65553]: INFO networking_nsxv3.common.synchronization [req-632e1389-7d2a-4fe3-beb6-1e61b56a873d req-7fb26636-2b69-4961-ac84-7552f30db802 tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1246.100691] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1246.101018] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.101101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.101154] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.101347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.101783] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.101783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.101783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.101783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.102082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.102082] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.392765] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.392953] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.393085] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.393358] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.393719] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.398139] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.398139] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.398139] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.398139] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.398139] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.398139] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.398139] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.398139] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.398139] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.398139] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.398139] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.419502] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.419725] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1246.419961] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.420122] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.420439] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-e0388ce2-514b-4e76-83fe-3a1226ca6be6 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.420727] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-e0388ce2-514b-4e76-83fe-3a1226ca6be6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.420853] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-e0388ce2-514b-4e76-83fe-3a1226ca6be6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.421199] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-e0388ce2-514b-4e76-83fe-3a1226ca6be6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.421335] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0388ce2-514b-4e76-83fe-3a1226ca6be6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.604160] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.718114] env[65553]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1246.718296] env[65553]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1d5f3d24-badb-4133-a5c6-225c416a7b6a None None] NSXv3 Agent Agent loop - iteration:3 started [ 1246.924083] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.924393] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.924553] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.924884] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.925085] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.925287] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port e0388ce2-514b-4e76-83fe-3a1226ca6be6 not found, creating... [ 1246.925607] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.925840] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.925958] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.926238] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.926414] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.926762] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.926965] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.927124] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.927368] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.927544] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.927712] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: e0388ce2-514b-4e76-83fe-3a1226ca6be6 is going to be created. [ 1246.956872] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.957136] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.957297] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.957616] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.957886] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.958176] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-e0388ce2-514b-4e76-83fe-3a1226ca6be6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.106309] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.610822] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.610822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.610822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.610822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.610822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.610822] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1247.642021] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.642021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.642021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.642021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.642021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.652756] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1247.661751] env[65553]: INFO networking_nsxv3.common.synchronization [req-632e1389-7d2a-4fe3-beb6-1e61b56a873d req-e0f20709-347e-4ac8-967d-82cd3eaf03e0 service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1247.661751] env[65553]: INFO networking_nsxv3.common.synchronization [req-632e1389-7d2a-4fe3-beb6-1e61b56a873d req-e0f20709-347e-4ac8-967d-82cd3eaf03e0 service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1247.661751] env[65553]: INFO networking_nsxv3.common.synchronization [req-632e1389-7d2a-4fe3-beb6-1e61b56a873d req-e0f20709-347e-4ac8-967d-82cd3eaf03e0 service nova] Enqueued Resource ID: e0388ce2-514b-4e76-83fe-3a1226ca6be6 with Priority: HIGHEST for action port [ 1247.661751] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1247.661751] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1247.661751] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0388ce2-514b-4e76-83fe-3a1226ca6be6 with Priority: HIGHEST for action port [ 1247.663701] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.664082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.664370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.664844] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.665058] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.670280] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.670280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.670280] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0388ce2-514b-4e76-83fe-3a1226ca6be6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.670280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0388ce2-514b-4e76-83fe-3a1226ca6be6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.670280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0388ce2-514b-4e76-83fe-3a1226ca6be6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.670280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0388ce2-514b-4e76-83fe-3a1226ca6be6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.673109] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0388ce2-514b-4e76-83fe-3a1226ca6be6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.175101] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.175620] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.175620] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0388ce2-514b-4e76-83fe-3a1226ca6be6 with status ACTIVE [ 1248.175751] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.175836] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.175949] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.176227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.176346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.176538] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.176618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.176672] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.176838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.176923] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.177249] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.177377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.177889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.177889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.177889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.177889] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0388ce2-514b-4e76-83fe-3a1226ca6be6 is going to be updated. [ 1248.201299] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.201566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.201566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.201787] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.201935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.202116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0388ce2-514b-4e76-83fe-3a1226ca6be6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.664437] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1249.664875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.664981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.665337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.665838] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.666025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.666136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.666362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.666482] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.666620] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.169577] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.672186] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.175484] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.175685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.175728] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.175979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.176097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.176200] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1251.210397] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.210546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.210755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.211045] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.211207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.221632] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1252.662463] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.662463] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1253.234146] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1253.234146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.234146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.234146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.234439] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.234439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.234439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.234629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.234629] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.234700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.234732] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.737050] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.737351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.737442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.737683] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.737922] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.738092] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.738748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.738748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.738748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.738748] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.738748] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.738986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.738986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.739737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.739737] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.739737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.739737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.739737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.739737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.739989] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.739989] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.242578] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f1bcf27-527e-4011-8166-1643df6e3b9a: rpc.has_security_group_logging(os_id): False [ 1254.260322] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.260532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.260532] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.260900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.261021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.261316] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.261429] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.261491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.261668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.261774] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.262146] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.262252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.262318] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.262469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.262546] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.262748] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.262879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.262941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.263056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.263131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.263217] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1254.322575] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.322874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.322874] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.322999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.323178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.336319] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1256.353767] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1256.354063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.663450] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.667527] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1258.784782] env[65553]: INFO networking_nsxv3.common.synchronization [req-99a8e3fc-8ec4-4bfc-8eee-3f9b461350a6 req-91ba5f7c-0f95-4963-aa41-83445ace730a tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1258.786097] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1258.786515] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.786707] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.786817] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.787096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.787261] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.787417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.788097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.788097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.788097] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.788097] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.292444] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.795376] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.297554] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.297710] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.297783] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.297994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.298102] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.298200] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1260.337184] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.337422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.337422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.337593] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.337733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.349563] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1260.377286] env[65553]: INFO networking_nsxv3.common.synchronization [req-57216a93-9a0c-4cc7-a616-19d902d3f225 req-498e933f-51b7-42b5-8463-585d5cdbd197 tempest-ServerActionsTestJSON-1152169178 tempest-ServerActionsTestJSON-1152169178-project-member] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1260.377863] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGHEST for action security_group_members [ 1260.378150] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.378272] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.378337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.378547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.378849] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.378968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.379083] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.379219] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.379303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.379401] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.882069] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.882481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.882481] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.882566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.882601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.882812] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.882917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.882981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.883186] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.883286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.883940] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be updated. [ 1260.915496] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.915764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.915764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.915963] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.916057] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.926218] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: IN_PROGRESS for 2s [ 1262.360351] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1262.360727] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.937201] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 in Status: SUCCESS [ 1262.937385] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 deletion is rescheduled due to dependency. [ 1262.937499] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.999741] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.999933] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.000069] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.000341] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.000592] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.000854] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.000936] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.001176] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.001317] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.001522] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.001633] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1263.001738] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1263.001908] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1263.002037] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.002141] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1263.002267] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1263.021172] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1263.021335] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1263.021491] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1263.021656] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-467" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.022072] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.022259] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.022368] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.022628] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.022801] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81ae4cb2-8f27-4db1-a1cc-6af809be9a86',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.525326] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.525839] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.525839] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.525997] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.526208] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.526489] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.526662] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.526777] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.527012] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.527172] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.527516] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.527701] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.527827] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.528075] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.528240] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.528384] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 is going to be updated. [ 1263.559173] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.559492] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.559739] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.560205] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.560511] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.560857] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.243656] env[65553]: INFO networking_nsxv3.common.synchronization [req-e5b67fc3-d1b7-437c-a501-f8f5e884f963 req-26f4131f-5576-45f0-b6cd-637ff9300fa4 service nova] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 1264.243932] env[65553]: INFO networking_nsxv3.common.synchronization [req-e5b67fc3-d1b7-437c-a501-f8f5e884f963 req-26f4131f-5576-45f0-b6cd-637ff9300fa4 service nova] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1264.244191] env[65553]: INFO networking_nsxv3.common.synchronization [req-e5b67fc3-d1b7-437c-a501-f8f5e884f963 req-26f4131f-5576-45f0-b6cd-637ff9300fa4 service nova] Enqueued Resource ID: 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 with Priority: HIGHEST for action port [ 1264.244953] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_rules [ 1264.245115] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1264.245276] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 with Priority: HIGHEST for action port [ 1264.245665] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.245838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.246113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.246418] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.246546] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.247808] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.247976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.248101] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.248358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.248962] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.248962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.248962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.249169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.249203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.249305] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.250111] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.250216] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.250282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.250432] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.250507] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81ae4cb2-8f27-4db1-a1cc-6af809be9a86',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.753539] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.753930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.753930] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.754793] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 with status ACTIVE [ 1264.754985] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.755119] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.755168] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.755373] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.755461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.755640] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.755737] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.755799] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.755973] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.756066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.756247] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.756341] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.756399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.756537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.756614] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.756699] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81ae4cb2-8f27-4db1-a1cc-6af809be9a86 is going to be updated. [ 1264.782583] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.782808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.782808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.782983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.783137] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.783296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81ae4cb2-8f27-4db1-a1cc-6af809be9a86" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.258385] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.761353] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.761751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.761751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.761916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.762048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.762185] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be updated. [ 1265.794149] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.794149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.794149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.794149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.794149] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.804881] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1267.817011] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1267.817334] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.817401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.817655] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.817862] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.817988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.818067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.818227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.818309] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.818422] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.818507] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.321301] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.823510] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 015f5088-3b94-432c-9304-6fd98b4fe26a: rpc.has_security_group_logging(os_id): False [ 1268.846204] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.846357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.846431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.846649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.846749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.847034] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.847145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.847196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.847399] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.847551] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.847625] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be updated. [ 1268.930185] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.930472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.930472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.930751] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.930971] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.948310] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1269.246134] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.246244] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1270.099427] env[65553]: INFO networking_nsxv3.common.synchronization [req-cde101dc-91cd-41d8-a25e-b5ea3b9fa46f req-1e2e6f54-1248-4119-bb23-b8e554e460e8 tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1270.100420] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1270.100767] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.100945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.101033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.101217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.101849] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.101849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.101849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.101849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.101849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.101849] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.603981] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.833023] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.833023] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.833023] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.833023] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.833023] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.833414] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.833414] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.833766] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.834052] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.834412] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.834623] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.834843] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.835063] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.835294] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.835514] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.835738] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1270.855438] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1270.855600] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1270.855735] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1270.855906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.856269] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-576880cf-49d4-4c72-97d3-6d9f587a8a07 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.856447] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-576880cf-49d4-4c72-97d3-6d9f587a8a07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.856565] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-576880cf-49d4-4c72-97d3-6d9f587a8a07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.856899] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-576880cf-49d4-4c72-97d3-6d9f587a8a07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.857342] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('576880cf-49d4-4c72-97d3-6d9f587a8a07',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.967053] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1270.967389] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.106111] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.360058] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.360313] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.360404] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.360692] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.360901] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.361094] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 576880cf-49d4-4c72-97d3-6d9f587a8a07 not found, creating... [ 1271.361371] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.361536] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.361659] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.361890] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.362049] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.362346] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.362563] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.362717] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.362947] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.363102] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.363309] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 576880cf-49d4-4c72-97d3-6d9f587a8a07 is going to be created. [ 1271.385920] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.386240] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.386376] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.386695] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.386919] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.387158] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-576880cf-49d4-4c72-97d3-6d9f587a8a07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.608802] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.609066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.609118] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.609354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.609472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.609598] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1271.642660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.642870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.642870] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.643031] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.643198] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.655950] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1272.099179] env[65553]: INFO networking_nsxv3.common.synchronization [req-cde101dc-91cd-41d8-a25e-b5ea3b9fa46f req-4163bd2a-befa-440b-9a3f-cf69386ac255 service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1272.099396] env[65553]: INFO networking_nsxv3.common.synchronization [req-cde101dc-91cd-41d8-a25e-b5ea3b9fa46f req-4163bd2a-befa-440b-9a3f-cf69386ac255 service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1272.099536] env[65553]: INFO networking_nsxv3.common.synchronization [req-cde101dc-91cd-41d8-a25e-b5ea3b9fa46f req-4163bd2a-befa-440b-9a3f-cf69386ac255 service nova] Enqueued Resource ID: 576880cf-49d4-4c72-97d3-6d9f587a8a07 with Priority: HIGHEST for action port [ 1272.100157] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1272.100295] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1272.100393] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 576880cf-49d4-4c72-97d3-6d9f587a8a07 with Priority: HIGHEST for action port [ 1272.100689] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.100821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.100926] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.101148] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.101311] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.102158] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.102264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.102475] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-576880cf-49d4-4c72-97d3-6d9f587a8a07 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.102585] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-576880cf-49d4-4c72-97d3-6d9f587a8a07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.102652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-576880cf-49d4-4c72-97d3-6d9f587a8a07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.102889] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-576880cf-49d4-4c72-97d3-6d9f587a8a07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.102889] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('576880cf-49d4-4c72-97d3-6d9f587a8a07',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.604618] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.605084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.605084] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 576880cf-49d4-4c72-97d3-6d9f587a8a07 with status ACTIVE [ 1272.605238] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.605410] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.605475] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.605695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.605803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.606016] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.606123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.606183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.606340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.606416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.606596] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.606680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.606739] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.606873] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.606945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.607038] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 576880cf-49d4-4c72-97d3-6d9f587a8a07 is going to be updated. [ 1272.632028] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.632259] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.632339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.632574] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.632716] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.632924] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-576880cf-49d4-4c72-97d3-6d9f587a8a07" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.665824] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1273.666257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.666257] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.666477] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.666664] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.666781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.666838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.666991] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.667086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.667180] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.169514] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.671457] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.175808] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.176038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.176038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.176288] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.176386] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.176483] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1275.208195] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.208417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.208417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.208613] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.208767] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.221601] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1277.101398] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.101806] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1277.233977] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1277.234220] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.234387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.234616] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.234814] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.234932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.234998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.235165] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.235246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.235336] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.235422] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.737785] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.737939] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.737996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.738260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.738438] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.738544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.738601] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.738749] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.738837] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.738938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.739100] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.739193] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.739251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.739398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.739537] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.739666] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.739714] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.739811] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.739898] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.739965] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.740068] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.243156] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f1bcf27-527e-4011-8166-1643df6e3b9a: rpc.has_security_group_logging(os_id): False [ 1278.261772] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.262046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.262046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.262301] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.262405] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.262628] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.262733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.262798] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.262962] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.263055] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.263233] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.263325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.263384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.263529] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.263587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.263770] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.263861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.263919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.264069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.264145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.264224] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1278.348418] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.348684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.348684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.348839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.348990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.364659] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1280.381334] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1280.381792] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.102733] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.103146] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1282.446991] env[65553]: INFO networking_nsxv3.common.synchronization [req-be3bf102-edd9-48ae-915d-e1855a3810e6 req-acc7f96a-8b37-4948-9afb-b5895524bcea tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1282.447433] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1282.448226] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.448313] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.448350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.448542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.448696] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.448796] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.448857] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.449104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.449178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.449287] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.564621] env[65553]: INFO networking_nsxv3.common.synchronization [req-0b175575-78dd-4cd1-b1af-2fb25bda6aa1 req-3deced6a-6b05-492d-82e7-6235141f5e23 tempest-ServerActionsTestOtherB-2131075409 tempest-ServerActionsTestOtherB-2131075409-project-member] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1282.565259] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGHEST for action security_group_members [ 1282.565651] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.565822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.565895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.566136] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.566322] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.566442] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.566521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.566705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.566808] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.566918] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.951327] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.069656] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.070037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.070203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.070491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.071380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.071628] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.071742] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.071802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.072047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.072141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.072236] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be updated. [ 1283.104412] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.104981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.104981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.104981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.104981] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.113486] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: IN_PROGRESS for 2s [ 1283.454414] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.957290] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.957491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.957491] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.957674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.957765] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.957864] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1283.986175] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.986337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.986394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.986602] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.986731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.997318] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1285.123582] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 015f5088-3b94-432c-9304-6fd98b4fe26a in Status: SUCCESS [ 1285.123930] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a deletion is rescheduled due to dependency. [ 1285.123930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.007111] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1286.007344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.566114] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1287.566541] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1291.729231] env[65553]: INFO networking_nsxv3.common.synchronization [req-89f7ca08-52a2-454b-bd1b-654fd3288586 req-38b3b6d3-c56e-426e-ba51-88aa03cd70da tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1291.729637] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1291.729969] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.730151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.730236] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.730453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.730618] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.730719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.730789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.730961] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.731064] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.731212] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.069361] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.069733] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.069930] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.070261] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.070823] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.071125] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.071292] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.071529] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.071684] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.071921] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.072108] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.072284] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.072478] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.072628] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.072860] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.073038] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.098735] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.098973] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1292.099045] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.099228] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.099589] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-79e44244-5805-4e43-921a-fcbd025a055a taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.099769] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-79e44244-5805-4e43-921a-fcbd025a055a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.099889] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-79e44244-5805-4e43-921a-fcbd025a055a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.100267] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-79e44244-5805-4e43-921a-fcbd025a055a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.100405] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79e44244-5805-4e43-921a-fcbd025a055a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.233978] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.603443] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.603683] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.603808] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.604105] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.604260] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.604416] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 79e44244-5805-4e43-921a-fcbd025a055a not found, creating... [ 1292.604715] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.604889] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.605013] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.605246] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.605385] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.605681] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.605840] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.605953] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.606213] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.606395] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.606540] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 79e44244-5805-4e43-921a-fcbd025a055a is going to be created. [ 1292.628969] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.629267] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.629373] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.629662] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.629889] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.630127] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-79e44244-5805-4e43-921a-fcbd025a055a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.737396] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.241244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.241415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.241485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.241703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.241790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.241888] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1293.271451] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.271676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.271676] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.271852] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.271990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.281218] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1293.304104] env[65553]: INFO networking_nsxv3.common.synchronization [req-89f7ca08-52a2-454b-bd1b-654fd3288586 req-ed87a111-e287-4be9-abd1-1b682234e1bc service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1293.304215] env[65553]: INFO networking_nsxv3.common.synchronization [req-89f7ca08-52a2-454b-bd1b-654fd3288586 req-ed87a111-e287-4be9-abd1-1b682234e1bc service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1293.304370] env[65553]: INFO networking_nsxv3.common.synchronization [req-89f7ca08-52a2-454b-bd1b-654fd3288586 req-ed87a111-e287-4be9-abd1-1b682234e1bc service nova] Enqueued Resource ID: 79e44244-5805-4e43-921a-fcbd025a055a with Priority: HIGHEST for action port [ 1293.304604] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1293.304732] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1293.304827] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79e44244-5805-4e43-921a-fcbd025a055a with Priority: HIGHEST for action port [ 1293.305444] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.305573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.305671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.305814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.305892] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.307281] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.307281] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.307493] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-79e44244-5805-4e43-921a-fcbd025a055a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.307493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79e44244-5805-4e43-921a-fcbd025a055a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.307607] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79e44244-5805-4e43-921a-fcbd025a055a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.307830] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79e44244-5805-4e43-921a-fcbd025a055a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.307830] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79e44244-5805-4e43-921a-fcbd025a055a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.809925] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79e44244-5805-4e43-921a-fcbd025a055a with status ACTIVE [ 1293.810282] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.810282] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.810401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.810509] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.810603] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.810779] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.810876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.810933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.811146] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.811234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.811420] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.811512] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.811573] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.811712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.811785] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.811867] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79e44244-5805-4e43-921a-fcbd025a055a is going to be updated. [ 1293.813046] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.813151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.835804] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.835999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.835999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.836225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.836454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.836623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79e44244-5805-4e43-921a-fcbd025a055a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.292939] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1295.293533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.293533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.293700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.293870] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.293995] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.294076] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.294286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.294405] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.294492] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.796706] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.299431] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.801603] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.801802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.801848] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.802079] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.802175] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.802285] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1296.830449] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.830682] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.830734] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.830942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.831095] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.839486] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1298.305870] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.306199] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1298.851548] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1298.851800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.851943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.852210] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.852417] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.852544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.852604] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.852834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.852834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.852933] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.853018] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.355412] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.355842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.355842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.355990] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.356189] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.356357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.356461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.356675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.356802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.356901] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.357074] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.357170] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.357233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.357379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.357517] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.357639] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.357711] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.357853] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.357930] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.358024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.358117] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.860219] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f1bcf27-527e-4011-8166-1643df6e3b9a: rpc.has_security_group_logging(os_id): False [ 1299.880222] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.880485] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.880545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.880826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.880946] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.881273] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.881382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.881450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.881633] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.881715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.881917] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.882038] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.882104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.882273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.882344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.882564] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.882643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.882705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.882863] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.882941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.883048] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1299.970467] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.970467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.970467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.970467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.970467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.986234] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1301.652456] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.652879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.652879] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.652987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.653063] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.003581] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1302.003803] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.155767] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.658500] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.161533] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1303.161723] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1303.308091] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.308447] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.942124] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.942124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.942124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.942124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.955010] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1303.956252] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.957417] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1303.994730] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.994905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.994905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.995128] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.009920] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.010847] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1304.010935] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.011081] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1304.056358] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.056610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.056610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.056790] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.058096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.058315] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1304.140644] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.140902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.140902] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.141058] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.141420] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.141701] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1304.228115] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.228382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.228382] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.228569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.228960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.229415] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1304.229558] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'45d61543-0c85-4845-bdc5-d666ed96b205', '8d626d81-6003-4f84-b690-4708f139d600', 'd1246751-d3c4-4099-b16f-aa9fe0e1b1a6', 'f4ee4c50-7cd1-464f-8791-a617053e06f6', '8f1bcf27-527e-4011-8166-1643df6e3b9a', '9009da09-3880-4f06-b8cc-6f3ff62a7fbd', '015f5088-3b94-432c-9304-6fd98b4fe26a', 'fb67cc18-9ceb-429a-844d-a60317217b7b', '15032a54-f6e7-41b8-855b-0262e8fb39c5', '4a425597-2f3a-4763-9abe-b15432eceec7', 'ba740e0c-2e37-407f-9332-eb55708d440c', '47ac6222-df91-40b6-8703-f88ab52afe33', 'ed7cc46a-1914-49e3-8b7d-d67e2682c5f6', 'de664cf7-0945-48b8-9372-6d843b23be0e', '13fb7ebd-1acf-4b5d-9518-5e68b8030e0f', '84881d5c-05c0-4bde-84e9-437b2da92669', '30f1992f-8f85-4326-932f-434571d97d70', '510c04b8-85b7-4488-b4cf-5880529fe0b5', '5dd4fd13-5d20-444e-a455-6722e01bb869', '537bc2bc-cdf2-4458-b7d2-e407a1378139', '87be6074-60bc-4100-998c-628cc41a4590', 'b7d6f932-0d6e-4b85-a4f1-f60e841549d8', 'f3d9a09b-bf97-4de9-910d-f878fc6b267c', 'ec66a418-d823-4b2f-87e2-c61e09ea9de4', '0381d463-a205-4270-82ca-0eb7d56637ee', '54d93d69-4c1f-45f9-bd84-41ef7facb6ae', '76312788-a044-46c4-912d-a43bc9c8e59f', '762d4374-c484-417a-aad8-0a36a186516f', 'ebd49ee0-d72a-443f-a112-9fa0a970c7be', '28be331c-2041-41ac-9f2a-5746e8762908', 'ad458bc8-8a48-49a7-9f97-e510476fdf4f', 'a7ba6400-0dc9-4a80-ad83-aeeb3037ae85', 'f1d8093c-cd24-42d6-a98f-e99ee4f38b99', 'd2ef9829-ef49-436a-a11a-bae751628c4a', '1e7647e8-bc93-4ca1-af77-c7da9c980011', 'b60f68fd-25de-4d38-bc93-3e4066ff8aa6', 'fd69ea1e-9ecd-47c1-b65c-87418794c033', '75ff2ed9-6e49-4d62-a3e7-345569ebb0f7', '9d5d7b40-1056-43d4-a9d4-099288f67f0f', '066e3ae9-ef84-454d-bd16-ad65fcc46e8f', 'ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8', '354651da-2fa6-41a7-a3bb-8655872e6da5'} {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.229692] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1304.251658] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.251883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.251883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.252056] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.252145] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.252262] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1304.252335] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.252407] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1304.332973] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.333179] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.333264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.333567] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.335291] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.335666] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1304.335781] env[65553]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65553) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.335888] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1304.335991] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1304.336119] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1304.336225] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGH for action security_group_rules [ 1304.336350] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d626d81-6003-4f84-b690-4708f139d600 with Priority: HIGH for action security_group_rules [ 1304.336454] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGH for action security_group_rules [ 1304.336553] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGH for action security_group_rules [ 1304.336648] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGH for action security_group_rules [ 1304.336741] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGH for action security_group_rules [ 1304.336833] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGH for action security_group_rules [ 1304.336925] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGH for action security_group_rules [ 1304.337032] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGH for action security_group_rules [ 1304.337126] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGH for action security_group_rules [ 1304.337217] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba740e0c-2e37-407f-9332-eb55708d440c with Priority: HIGH for action security_group_rules [ 1304.337307] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47ac6222-df91-40b6-8703-f88ab52afe33 with Priority: HIGH for action security_group_rules [ 1304.337398] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 with Priority: HIGH for action security_group_rules [ 1304.337489] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de664cf7-0945-48b8-9372-6d843b23be0e with Priority: HIGH for action security_group_rules [ 1304.337580] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGH for action security_group_rules [ 1304.337701] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84881d5c-05c0-4bde-84e9-437b2da92669 with Priority: HIGH for action security_group_rules [ 1304.337760] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30f1992f-8f85-4326-932f-434571d97d70 with Priority: HIGH for action security_group_rules [ 1304.337849] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGH for action security_group_rules [ 1304.337938] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 with Priority: HIGH for action security_group_rules [ 1304.338039] env[65553]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGH for action security_group_rules [ 1304.338178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.794810] env[65553]: INFO networking_nsxv3.common.synchronization [req-eb679d38-690c-43fd-b959-e0036fa17aaf req-98a6255f-c47c-48e1-890c-302b7d01b696 tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1305.795385] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1305.795565] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45d61543-0c85-4845-bdc5-d666ed96b205 with Priority: HIGH for action security_group_rules [ 1305.795677] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 with Priority: HIGH for action security_group_rules [ 1305.795776] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 015f5088-3b94-432c-9304-6fd98b4fe26a with Priority: HIGH for action security_group_rules [ 1305.795872] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGH for action security_group_rules [ 1305.795964] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 with Priority: HIGH for action security_group_rules [ 1305.796068] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 with Priority: HIGH for action security_group_rules [ 1305.796168] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 with Priority: HIGH for action security_group_rules [ 1305.796286] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30f1992f-8f85-4326-932f-434571d97d70 with Priority: HIGH for action security_group_rules [ 1305.796381] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de664cf7-0945-48b8-9372-6d843b23be0e with Priority: HIGH for action security_group_rules [ 1305.796469] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84881d5c-05c0-4bde-84e9-437b2da92669 with Priority: HIGH for action security_group_rules [ 1305.796555] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 with Priority: HIGH for action security_group_rules [ 1305.796638] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ac6222-df91-40b6-8703-f88ab52afe33 with Priority: HIGH for action security_group_rules [ 1305.796722] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba740e0c-2e37-407f-9332-eb55708d440c with Priority: HIGH for action security_group_rules [ 1305.796854] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a425597-2f3a-4763-9abe-b15432eceec7 with Priority: HIGH for action security_group_rules [ 1305.796988] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 with Priority: HIGH for action security_group_rules [ 1305.797107] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd with Priority: HIGH for action security_group_rules [ 1305.797218] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb67cc18-9ceb-429a-844d-a60317217b7b with Priority: HIGH for action security_group_rules [ 1305.797337] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGH for action security_group_rules [ 1305.797440] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d626d81-6003-4f84-b690-4708f139d600 with Priority: HIGH for action security_group_rules [ 1305.797530] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 with Priority: HIGH for action security_group_rules [ 1305.797840] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.797957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.798033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.798260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.798530] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.798530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.798642] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.798730] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.798813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.798903] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.801598] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45d61543-0c85-4845-bdc5-d666ed96b205 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.801598] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.801761] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.801814] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.801894] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45d61543-0c85-4845-bdc5-d666ed96b205',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.802684] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.802782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.802843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.802998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.803083] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1246751-d3c4-4099-b16f-aa9fe0e1b1a6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.803809] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-015f5088-3b94-432c-9304-6fd98b4fe26a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.803912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.804899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.804899] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.804899] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('015f5088-3b94-432c-9304-6fd98b4fe26a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.805320] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.805652] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.805731] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.805887] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.805958] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.806992] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-537bc2bc-cdf2-4458-b7d2-e407a1378139 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.806992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.806992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.807182] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.807182] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('537bc2bc-cdf2-4458-b7d2-e407a1378139',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.809653] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dd4fd13-5d20-444e-a455-6722e01bb869 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.809653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.809653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.809653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.809653] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dd4fd13-5d20-444e-a455-6722e01bb869',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.809873] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-510c04b8-85b7-4488-b4cf-5880529fe0b5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.809994] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.810080] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.810192] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.810261] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('510c04b8-85b7-4488-b4cf-5880529fe0b5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.810960] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30f1992f-8f85-4326-932f-434571d97d70 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.811072] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.811127] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.811244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.811481] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30f1992f-8f85-4326-932f-434571d97d70',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.812108] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de664cf7-0945-48b8-9372-6d843b23be0e taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.812214] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.812781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.812781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.812781] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de664cf7-0945-48b8-9372-6d843b23be0e',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.813198] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84881d5c-05c0-4bde-84e9-437b2da92669 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.813299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.813364] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.813547] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.813626] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84881d5c-05c0-4bde-84e9-437b2da92669',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.814545] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.814545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.814545] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.814724] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.814724] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed7cc46a-1914-49e3-8b7d-d67e2682c5f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.815789] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47ac6222-df91-40b6-8703-f88ab52afe33 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.815789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.815789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.815789] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.815789] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47ac6222-df91-40b6-8703-f88ab52afe33',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.816508] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba740e0c-2e37-407f-9332-eb55708d440c taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.816606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.816893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.816893] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.816893] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba740e0c-2e37-407f-9332-eb55708d440c',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.817862] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a425597-2f3a-4763-9abe-b15432eceec7 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.817862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.817862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.817862] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.818098] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a425597-2f3a-4763-9abe-b15432eceec7',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.819086] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15032a54-f6e7-41b8-855b-0262e8fb39c5 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.819086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.819086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.819086] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.819086] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15032a54-f6e7-41b8-855b-0262e8fb39c5',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.821588] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.821705] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.821771] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.821932] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.822023] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9009da09-3880-4f06-b8cc-6f3ff62a7fbd',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.823064] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb67cc18-9ceb-429a-844d-a60317217b7b taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.823169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.823287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.823390] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.823462] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb67cc18-9ceb-429a-844d-a60317217b7b',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.824364] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.824467] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.824566] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.824675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.824748] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.825629] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d626d81-6003-4f84-b690-4708f139d600 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.825696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.825769] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.825895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.825968] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d626d81-6003-4f84-b690-4708f139d600',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.826640] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4ee4c50-7cd1-464f-8791-a617053e06f6 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.826822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.826917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.827292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.827292] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4ee4c50-7cd1-464f-8791-a617053e06f6',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.853275] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.853387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.853461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.853823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.875957] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.876117] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 015f5088-3b94-432c-9304-6fd98b4fe26a is going to be deleted. [ 1305.935634] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.935634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.935634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.935634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.935634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.935634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-015f5088-3b94-432c-9304-6fd98b4fe26a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.113575] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.113786] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.113866] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.114145] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.114661] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.114661] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.114661] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.114906] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.114985] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.115200] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1306.115311] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1306.115415] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1306.115525] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1306.115623] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1306.115725] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1306.115850] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1306.135220] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1306.135420] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1306.135515] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1306.135678] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.135982] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-d39862a4-730a-49e5-ae9a-e47d0d6cb1ea taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.136165] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-d39862a4-730a-49e5-ae9a-e47d0d6cb1ea" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.136280] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-d39862a4-730a-49e5-ae9a-e47d0d6cb1ea" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.136622] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-d39862a4-730a-49e5-ae9a-e47d0d6cb1ea" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.136758] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39862a4-730a-49e5-ae9a-e47d0d6cb1ea',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.301951] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.329190] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.329417] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.333414] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.333564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.333623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.333791] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.333939] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.334052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.334116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.334264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.334351] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.334435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.334521] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.377165] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.377165] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.377165] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.377679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.412716] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.413021] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.414554] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.414679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.415550] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.415660] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.416693] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.416819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.417654] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.417782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.418595] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.418706] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.419932] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.420067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.420854] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.420987] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.421867] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.421979] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.422903] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.423052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.423985] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.424471] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.424610] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.425449] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.425737] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.425839] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.426631] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.426920] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.427047] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.427623] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.428067] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.428191] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.428816] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.429813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.429813] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de664cf7-0945-48b8-9372-6d843b23be0e is going to be deleted. [ 1306.430823] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.430917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.430982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.431203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.432573] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.432674] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.450854] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.451411] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.451556] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a425597-2f3a-4763-9abe-b15432eceec7 is going to be deleted. [ 1306.452649] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.452854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.472013] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.472195] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84881d5c-05c0-4bde-84e9-437b2da92669 is going to be deleted. [ 1306.473339] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.473671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.495651] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.495809] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.504087] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.504258] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.509833] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.509833] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9009da09-3880-4f06-b8cc-6f3ff62a7fbd is going to be deleted. [ 1306.510513] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.510671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.534892] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.535032] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.543290] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.543428] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1246751-d3c4-4099-b16f-aa9fe0e1b1a6 is going to be deleted. [ 1306.544325] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.544534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.601024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.601024] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dd4fd13-5d20-444e-a455-6722e01bb869 is going to be deleted. [ 1306.602196] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.602522] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.639056] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.639324] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.639451] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.639752] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.639905] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.640071] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port d39862a4-730a-49e5-ae9a-e47d0d6cb1ea not found, creating... [ 1306.640344] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.640512] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.640627] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.640849] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.640986] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.641290] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.641457] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.641573] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.641780] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.641912] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.642061] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: d39862a4-730a-49e5-ae9a-e47d0d6cb1ea is going to be created. [ 1306.746380] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.746679] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.746679] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.746984] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.747232] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.747468] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-d39862a4-730a-49e5-ae9a-e47d0d6cb1ea" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.759755] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.759951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.766234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.766431] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 537bc2bc-cdf2-4458-b7d2-e407a1378139 is going to be deleted. [ 1306.767314] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.767525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.788653] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.788929] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.792263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.792442] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed7cc46a-1914-49e3-8b7d-d67e2682c5f6 is going to be deleted. [ 1306.793345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.793554] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.804789] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.805173] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.805173] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.840142] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.840371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.840371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.840665] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.840736] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.840840] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.840904] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.841069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.841233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.841233] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.841431] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.841552] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.841670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.841722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.841860] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.841945] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.842011] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.842161] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.842300] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.842366] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.842433] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.869527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.869722] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d626d81-6003-4f84-b690-4708f139d600 is going to be deleted. [ 1306.871093] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.871449] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.919438] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.919638] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.927209] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.927398] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.935983] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.936173] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45d61543-0c85-4845-bdc5-d666ed96b205 is going to be deleted. [ 1306.937144] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.937431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.975878] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.976040] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb67cc18-9ceb-429a-844d-a60317217b7b is going to be deleted. [ 1306.977052] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.977294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.042142] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.042390] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4ee4c50-7cd1-464f-8791-a617053e06f6 is going to be deleted. [ 1307.043299] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.043537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.102675] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.102675] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.117392] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.117527] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30f1992f-8f85-4326-932f-434571d97d70 is going to be deleted. [ 1307.118533] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.118763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.141579] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.141797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.150956] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.151164] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.157229] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.157399] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47ac6222-df91-40b6-8703-f88ab52afe33 is going to be deleted. [ 1307.158379] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.158594] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.231981] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.232204] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.233384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.233384] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 510c04b8-85b7-4488-b4cf-5880529fe0b5 is going to be deleted. [ 1307.234238] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.234450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.236944] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.237122] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.275343] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.275469] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15032a54-f6e7-41b8-855b-0262e8fb39c5 is going to be deleted. [ 1307.276444] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.276668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.278161] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.278277] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.307484] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.307644] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.307690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.308171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.308171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.308171] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1307.345263] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f: rpc.has_security_group_logging(os_id): False [ 1307.357157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.357329] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba740e0c-2e37-407f-9332-eb55708d440c is going to be deleted. [ 1307.358245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.358459] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.358550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.358679] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de664cf7-0945-48b8-9372-6d843b23be0e" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.358838] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.358998] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.359092] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.359235] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a425597-2f3a-4763-9abe-b15432eceec7" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.359755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.359941] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.360081] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.360143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84881d5c-05c0-4bde-84e9-437b2da92669" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.360294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.360461] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.360536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.360653] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9009da09-3880-4f06-b8cc-6f3ff62a7fbd" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.360780] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.360919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.360992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.361123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1246751-d3c4-4099-b16f-aa9fe0e1b1a6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.361540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.361540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.361540] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.361673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dd4fd13-5d20-444e-a455-6722e01bb869" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.361831] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.361974] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.362062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.362176] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed7cc46a-1914-49e3-8b7d-d67e2682c5f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.362306] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.362465] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.362542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.362656] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-537bc2bc-cdf2-4458-b7d2-e407a1378139" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.362782] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.362922] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.362996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.363133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45d61543-0c85-4845-bdc5-d666ed96b205" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.363287] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.363433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.363508] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.363621] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d626d81-6003-4f84-b690-4708f139d600" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.363744] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.363883] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.363950] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.364084] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb67cc18-9ceb-429a-844d-a60317217b7b" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.364208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.364345] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.364431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.364564] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4ee4c50-7cd1-464f-8791-a617053e06f6" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.364699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.364876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.364960] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.365088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30f1992f-8f85-4326-932f-434571d97d70" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.365217] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.365357] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.365435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.365541] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47ac6222-df91-40b6-8703-f88ab52afe33" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.403227] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.403480] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.403544] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.403854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.410896] env[65553]: INFO networking_nsxv3.common.synchronization [req-eb679d38-690c-43fd-b959-e0036fa17aaf req-efde2021-534c-41b3-9ecc-955a8db09d92 service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1307.410954] env[65553]: INFO networking_nsxv3.common.synchronization [req-eb679d38-690c-43fd-b959-e0036fa17aaf req-efde2021-534c-41b3-9ecc-955a8db09d92 service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1307.411070] env[65553]: INFO networking_nsxv3.common.synchronization [req-eb679d38-690c-43fd-b959-e0036fa17aaf req-efde2021-534c-41b3-9ecc-955a8db09d92 service nova] Enqueued Resource ID: d39862a4-730a-49e5-ae9a-e47d0d6cb1ea with Priority: HIGHEST for action port [ 1307.412202] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.412396] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.412434] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.412613] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.412755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.414160] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1307.414316] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1307.414415] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d39862a4-730a-49e5-ae9a-e47d0d6cb1ea with Priority: HIGHEST for action port [ 1307.414688] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.414781] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.415038] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.415124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.415302] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-d39862a4-730a-49e5-ae9a-e47d0d6cb1ea taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.415401] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d39862a4-730a-49e5-ae9a-e47d0d6cb1ea" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.415501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d39862a4-730a-49e5-ae9a-e47d0d6cb1ea" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.415633] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d39862a4-730a-49e5-ae9a-e47d0d6cb1ea" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.415710] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39862a4-730a-49e5-ae9a-e47d0d6cb1ea',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.418056] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.418178] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.430504] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1307.446551] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.446755] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.478526] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.478828] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.478951] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.479030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.479378] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.479598] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.479884] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.480016] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.480303] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.480489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.480571] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.480771] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.480854] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.480916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.481082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.481151] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.481244] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f is going to be updated. [ 1307.482896] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.483096] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.483189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.483298] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15032a54-f6e7-41b8-855b-0262e8fb39c5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.483797] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.483954] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.484061] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.484231] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-510c04b8-85b7-4488-b4cf-5880529fe0b5" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.489199] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.489370] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.489414] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.489568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.489654] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.489826] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba740e0c-2e37-407f-9332-eb55708d440c" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.596208] env[65553]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1307.596875] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.597066] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.597143] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.597436] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.597598] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.648742] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: IN_PROGRESS for 2s [ 1307.917488] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d39862a4-730a-49e5-ae9a-e47d0d6cb1ea with status ACTIVE [ 1307.917890] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.917890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.917890] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.918155] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.918264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.918423] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.918549] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.918591] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.918740] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.918819] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.919013] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.919123] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.919179] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.919376] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.919423] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.919486] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d39862a4-730a-49e5-ae9a-e47d0d6cb1ea is going to be updated. [ 1307.952043] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.952043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.952043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.952043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.952043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.952359] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d39862a4-730a-49e5-ae9a-e47d0d6cb1ea" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.442224] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1309.442492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.442492] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.442713] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.442909] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.443040] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.443107] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.443263] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.443346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.443440] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.443537] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.444449] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.444634] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.444793] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.444917] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.444976] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.445125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.445215] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.445304] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.664892] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: SUCCESS [ 1309.665133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.668189] env[65553]: INFO networking_nsxv3.common.synchronization [req-c08dae4d-f347-4abe-a04b-eafc86bfa935 req-d3ee244d-6b41-42b4-8e45-6d39dea8d7ac tempest-ServerRescueNegativeTestJSON-1136890635 tempest-ServerRescueNegativeTestJSON-1136890635-project-member] Enqueued Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_members [ 1309.668845] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 with Priority: HIGHEST for action security_group_members [ 1309.669320] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.669462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.669589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.669822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.670030] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.670139] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.670199] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.670344] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.670424] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.670511] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.948543] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.948680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.948864] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.172887] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.173087] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.173165] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.173384] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.197181] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.197455] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.197577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.197645] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.197974] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.198131] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.198258] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 is going to be updated. [ 1310.223734] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.223928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.223928] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.224174] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.224317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.233342] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 in Status: IN_PROGRESS for 2s [ 1310.452859] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.954970] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.955218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.955327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.955556] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.955646] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.955776] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1310.986511] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.986729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.986729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.988179] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.988179] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.996424] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1312.245284] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 in Status: SUCCESS [ 1312.245700] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8 deletion is rescheduled due to dependency. [ 1312.245700] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab8015c0-f0a8-4c4f-9fb0-866ae1bfc5d8" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.007392] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1313.007636] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.007859] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.008421] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.008421] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.008577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.008623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.008827] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.008915] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.009025] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.009612] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.009612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.009612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.009612] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.009847] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.009847] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.009944] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.010075] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.010167] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.010247] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.010870] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.513447] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f1bcf27-527e-4011-8166-1643df6e3b9a: rpc.has_security_group_logging(os_id): False [ 1313.533152] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.533346] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.533387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.533578] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.558525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.558864] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.559046] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.559130] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.559416] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.559518] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.559769] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.559956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.559956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.560110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.560185] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.560377] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.560472] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.560524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.560668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.560747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.560841] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1313.624911] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.625153] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.625267] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.625501] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.625687] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.657678] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1314.670306] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.670637] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1315.678600] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1315.679012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.679012] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.679273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.679389] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.181452] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.181625] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.181685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.181931] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.182216] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.182279] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.182362] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.182608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.182692] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.182784] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.182873] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.685947] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.686448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.686448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.686448] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.686582] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.686684] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.686747] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.686900] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.686988] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.687094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.687244] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.687337] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.687397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.687536] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.687671] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.687763] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.687823] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.687956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.688043] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.688124] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.688208] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.987274] env[65553]: INFO networking_nsxv3.common.synchronization [req-1c0e94be-df91-4371-b6ea-05a6447c77fd req-6f40ba7a-2744-4455-9971-8b032df7d40d tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1316.987988] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1316.988378] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.988538] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.988623] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.988897] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.989138] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.989286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.989358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.989562] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.989659] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.989754] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.190510] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f1bcf27-527e-4011-8166-1643df6e3b9a: rpc.has_security_group_logging(os_id): False [ 1317.208646] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.208861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.208861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.209067] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.209157] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.209416] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.209528] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.209569] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.209773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.209821] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.209974] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.210062] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.210105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.210246] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.210317] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.210501] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.210618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.210680] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.210816] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.210912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.211010] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1317.266447] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.266690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.266690] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.266842] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.266984] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.283825] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1317.491530] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.993518] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.495955] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.496244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.496244] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.496413] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.496524] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.496634] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1318.530015] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.530208] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.530250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.530454] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.530600] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.540488] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1319.310015] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1319.310285] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.552134] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1320.552550] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.844591] env[65553]: INFO networking_nsxv3.common.synchronization [req-0e60d82c-a6bb-4c8a-96b6-8ec28e3c54fd req-f9fbae3f-44c1-4da8-8848-bd07ca704bb8 tempest-ServerRescueNegativeTestJSON-1136890635 tempest-ServerRescueNegativeTestJSON-1136890635-project-member] Enqueued Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1320.845316] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1320.845751] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.845942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.846024] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.846177] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.846323] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.846466] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.846534] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.846697] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.846818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.846919] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.351071] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.853243] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.356500] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.356733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.356733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.356943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.357049] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.357358] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f is going to be updated. [ 1322.389415] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.389575] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.389637] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.389800] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.389935] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.399443] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: IN_PROGRESS for 2s [ 1323.620785] env[65553]: INFO networking_nsxv3.common.synchronization [req-0a62bb70-8875-48be-a6a0-f8cd9964ab94 req-53fa386e-3e45-4837-975c-9172c2f037fe tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1323.621356] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1323.621721] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.621849] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.621937] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.622207] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.622375] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.622500] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.622572] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.622732] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.622818] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.622913] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.128072] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.410250] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: SUCCESS [ 1324.410462] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.631386] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.134179] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.134391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.134391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.134631] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.134719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.134831] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1325.165456] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.165696] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.165776] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.166069] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.166227] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.175747] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1327.187661] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1327.187661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.485896] env[65553]: INFO networking_nsxv3.common.synchronization [req-dc977cf0-4211-4d6e-a29f-7f1cd1d502f7 req-ca64da79-8c48-4315-9973-da1f045582af tempest-ServerRescueNegativeTestJSON-1136890635 tempest-ServerRescueNegativeTestJSON-1136890635-project-member] Enqueued Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1327.486446] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f with Priority: HIGHEST for action security_group_members [ 1327.487022] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.487022] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.487166] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.487322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.487397] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.487470] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.487521] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.487738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.487738] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.487887] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13fb7ebd-1acf-4b5d-9518-5e68b8030e0f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.990166] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.990333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.990394] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.990626] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.990721] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.990921] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.991030] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.991094] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.991245] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.991321] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.991408] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f is going to be updated. [ 1328.022390] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.022555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.022618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.022834] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.022977] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.032152] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: IN_PROGRESS for 2s [ 1330.044273] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f in Status: SUCCESS [ 1330.044722] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13fb7ebd-1acf-4b5d-9518-5e68b8030e0f deletion is rescheduled due to dependency. [ 1330.044722] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13fb7ebd-1acf-4b5d-9518-5e68b8030e0f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.487130] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1332.487416] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.568288] env[65553]: INFO networking_nsxv3.common.synchronization [req-06663c08-9323-4a42-9802-af769fc15801 req-940c2c22-a579-43ef-bd00-56c2c8a32c94 tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1333.568848] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1333.569182] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.569305] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.569372] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.569786] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.569786] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.569913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.569913] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.570074] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.570158] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.570249] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.903847] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.904037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.904169] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.904440] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.904685] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.904863] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.905066] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.905313] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.905462] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.905669] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1333.905780] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1333.905883] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1333.905986] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1333.906104] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1333.906206] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1333.906333] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1333.928037] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1333.928037] env[65553]: DEBUG dogpile.cache.region [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1333.928037] env[65553]: DEBUG dogpile.lock [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1333.928037] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.928285] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock port-2cc83630-195e-46da-9c8e-79883966919f taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.928285] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "port-2cc83630-195e-46da-9c8e-79883966919f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.928409] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "port-2cc83630-195e-46da-9c8e-79883966919f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.928714] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "port-2cc83630-195e-46da-9c8e-79883966919f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.928868] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cc83630-195e-46da-9c8e-79883966919f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.072775] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.431171] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.431447] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.431633] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.431942] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.432117] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.432276] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Segment Port 2cc83630-195e-46da-9c8e-79883966919f not found, creating... [ 1334.432534] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.432688] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.432829] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.433108] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.433307] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.433655] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.433816] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.434026] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.434288] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.434449] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.434591] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Resource: SegmentPort with ID: 2cc83630-195e-46da-9c8e-79883966919f is going to be created. [ 1334.456463] env[65553]: DEBUG networking_nsxv3.common.locking [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.456685] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.456777] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.457096] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.457328] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.457553] env[65553]: DEBUG oslo_concurrency.lockutils [None req-73985e2a-2f4b-4fa9-a633-68c1722b341e None None] Releasing lock "port-2cc83630-195e-46da-9c8e-79883966919f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.575990] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.077843] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.077843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.077843] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.078041] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.078260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.078334] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1335.108500] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.108665] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.108712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.108938] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.109104] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.120265] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1335.173064] env[65553]: INFO networking_nsxv3.common.synchronization [req-06663c08-9323-4a42-9802-af769fc15801 req-e13e8de2-5c4f-4a9c-918c-efb1b350fbfe service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1335.173347] env[65553]: INFO networking_nsxv3.common.synchronization [req-06663c08-9323-4a42-9802-af769fc15801 req-e13e8de2-5c4f-4a9c-918c-efb1b350fbfe service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1335.173508] env[65553]: INFO networking_nsxv3.common.synchronization [req-06663c08-9323-4a42-9802-af769fc15801 req-e13e8de2-5c4f-4a9c-918c-efb1b350fbfe service nova] Enqueued Resource ID: 2cc83630-195e-46da-9c8e-79883966919f with Priority: HIGHEST for action port [ 1335.174082] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1335.174234] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1335.174334] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc83630-195e-46da-9c8e-79883966919f with Priority: HIGHEST for action port [ 1335.174609] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.174778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.174778] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.174982] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.175078] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.176089] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.176089] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.176260] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cc83630-195e-46da-9c8e-79883966919f taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.176324] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cc83630-195e-46da-9c8e-79883966919f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.176358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cc83630-195e-46da-9c8e-79883966919f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.176511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cc83630-195e-46da-9c8e-79883966919f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.176580] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cc83630-195e-46da-9c8e-79883966919f',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.677935] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.678322] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.679405] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cc83630-195e-46da-9c8e-79883966919f with status ACTIVE [ 1335.679632] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.679788] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.679942] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.680183] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.680274] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.680919] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.680919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.680919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.680919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.680919] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.681358] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.681358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.681358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.681358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.681358] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.681600] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cc83630-195e-46da-9c8e-79883966919f is going to be updated. [ 1335.711916] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.711916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.711916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.711916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.711916] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.712307] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cc83630-195e-46da-9c8e-79883966919f" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.131201] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1337.131576] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.131715] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.131969] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.132197] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.132333] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.132391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.132592] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.132712] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.132821] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.635634] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.137744] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.640173] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.640395] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.640466] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.640670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.640773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.640879] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1338.678135] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.678340] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.678439] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.678719] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.678912] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.688743] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1340.175341] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.175774] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1340.699396] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1340.699597] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.699773] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.699992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.700243] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.700380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.700446] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.700605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.700685] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.700802] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.700901] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.203874] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.204292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.204292] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.204415] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.204660] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.204822] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.204871] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.205082] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.205206] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.205316] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.205500] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.205605] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.205708] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.205841] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.205987] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.206110] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.206164] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.206296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.206371] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.206450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.206538] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.709190] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f1bcf27-527e-4011-8166-1643df6e3b9a: rpc.has_security_group_logging(os_id): False [ 1341.730788] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.731063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.731063] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.731327] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.731479] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.731812] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.731968] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.732048] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.732170] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.732250] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.732439] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.732523] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.732587] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.732729] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.732825] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.733040] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.733141] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.733200] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.733331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.733405] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.733490] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1341.807415] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.807670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.807905] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.808169] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.808431] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.826745] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1343.847527] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1343.848037] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.176399] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.176771] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.197761] env[65553]: INFO networking_nsxv3.common.synchronization [req-17164412-334a-447f-833e-9a30f879de91 req-18d0cba6-1a08-4848-9de1-b83c348ba68a tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1345.198385] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1345.198744] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.198885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.198978] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.199249] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.199448] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.199561] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.199673] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.199861] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.199958] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.200062] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.702425] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.204368] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.707864] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.708111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.708111] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.708361] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.708489] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.708598] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1346.739028] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.739269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.739269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.739530] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.739699] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.748911] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1348.759810] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1348.760251] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.199783] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.200175] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1354.205467] env[65553]: INFO networking_nsxv3.common.synchronization [req-d99a6773-5198-4fb9-95c5-7c523dd15413 req-d37d31ea-0169-4338-9fa6-d767eedda057 tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1354.205972] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1354.206261] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.206380] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.206449] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.206643] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.206795] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.206892] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.207010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.207133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.207218] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.207309] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.489622] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock network-537 taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.489954] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.490102] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.490369] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.490682] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.490883] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.490995] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.491262] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.491407] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.491624] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1354.491738] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] NeedRegenerationException {{(pid=65553) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1354.491888] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] no value, waiting for create lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1354.492010] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] value creation lock acquired {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1354.492162] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] No value present for key: 'zone-id' {{(pid=65553) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1354.492265] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Calling creation function for not-yet-present value {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1354.492371] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1354.515332] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1354.515611] env[65553]: DEBUG dogpile.cache.region [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65553) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1354.515611] env[65553]: DEBUG dogpile.lock [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Released creation lock {{(pid=65553) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1354.515778] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "network-537" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.516131] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock port-06574108-ad62-4656-b756-bdef613fd6df taken with stack trace [, , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.516322] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "port-06574108-ad62-4656-b756-bdef613fd6df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.516468] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "port-06574108-ad62-4656-b756-bdef613fd6df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.516862] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "port-06574108-ad62-4656-b756-bdef613fd6df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.517013] env[65553]: DEBUG networking_nsxv3.api.rpc [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06574108-ad62-4656-b756-bdef613fd6df',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.709346] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.019266] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.019575] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.019702] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.020038] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.020226] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.020417] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Segment Port 06574108-ad62-4656-b756-bdef613fd6df not found, creating... [ 1355.020717] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.020930] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.021105] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.021369] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.021545] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.021905] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.022116] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.022266] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.022511] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.022662] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.022852] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Resource: SegmentPort with ID: 06574108-ad62-4656-b756-bdef613fd6df is going to be created. [ 1355.043836] env[65553]: DEBUG networking_nsxv3.common.locking [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.044066] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.044202] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.044476] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.044697] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.044982] env[65553]: DEBUG oslo_concurrency.lockutils [None req-69d7ead1-72fa-47f8-8bfd-2e1ef0fc571b None None] Releasing lock "port-06574108-ad62-4656-b756-bdef613fd6df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.211261] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.714602] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.714798] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.714876] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.715133] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.715225] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.715333] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1355.732205] env[65553]: INFO networking_nsxv3.common.synchronization [req-d99a6773-5198-4fb9-95c5-7c523dd15413 req-7be1397e-b877-4551-81f9-0fe472ce1909 service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1355.732370] env[65553]: INFO networking_nsxv3.common.synchronization [req-d99a6773-5198-4fb9-95c5-7c523dd15413 req-7be1397e-b877-4551-81f9-0fe472ce1909 service nova] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1355.732525] env[65553]: INFO networking_nsxv3.common.synchronization [req-d99a6773-5198-4fb9-95c5-7c523dd15413 req-7be1397e-b877-4551-81f9-0fe472ce1909 service nova] Enqueued Resource ID: 06574108-ad62-4656-b756-bdef613fd6df with Priority: HIGHEST for action port [ 1355.733055] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_rules [ 1355.733515] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1355.733620] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06574108-ad62-4656-b756-bdef613fd6df with Priority: HIGHEST for action port [ 1355.734058] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.734203] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.734241] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.734433] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.734513] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.735756] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.735885] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.736188] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock port-06574108-ad62-4656-b756-bdef613fd6df taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.736294] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06574108-ad62-4656-b756-bdef613fd6df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.736332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06574108-ad62-4656-b756-bdef613fd6df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.736662] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06574108-ad62-4656-b756-bdef613fd6df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.736662] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06574108-ad62-4656-b756-bdef613fd6df',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.744487] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.744671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.744671] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.744846] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.745008] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.754542] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1356.238380] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.238694] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.238694] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06574108-ad62-4656-b756-bdef613fd6df with status ACTIVE [ 1356.238851] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.238956] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.239033] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.239260] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.239347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.239514] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.239606] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.239670] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.239877] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.239959] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.240165] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.240273] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.240331] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.240542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.240542] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.240647] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06574108-ad62-4656-b756-bdef613fd6df is going to be updated. [ 1356.267763] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.267999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.267999] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.268205] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.268350] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.268527] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06574108-ad62-4656-b756-bdef613fd6df" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.778869] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1357.779377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.779377] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.779555] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.779821] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.779992] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.780106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.780326] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.780437] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.780574] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.283294] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.785577] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.288202] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.288450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.288450] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.288753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.288753] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.288905] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1359.316069] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.316234] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.316280] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.316537] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.316661] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.325936] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1360.734380] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.734801] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1361.337104] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1361.337403] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.337476] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.337695] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.337885] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.338010] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.338088] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.338269] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.338354] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.338441] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.338530] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.841524] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.841986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.841986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.841986] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.842182] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.842286] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.842347] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.842493] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.842577] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.842663] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.842804] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.842895] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.842943] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.843105] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.843243] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.843332] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.843397] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.843525] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.843608] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.843678] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.843768] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.346368] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f1bcf27-527e-4011-8166-1643df6e3b9a: rpc.has_security_group_logging(os_id): False [ 1362.367213] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.367419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.367419] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.367632] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.367725] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.367950] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.368125] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.368171] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.368312] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.368391] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.368573] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.368677] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.368735] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.368865] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.368940] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.369146] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.369264] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.369319] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.369435] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.369511] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.369595] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1362.427236] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.427460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.427460] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.427668] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.427764] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.447255] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1364.468204] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1364.468584] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.735852] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.735852] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1367.579996] env[65553]: INFO networking_nsxv3.common.synchronization [req-9a1561f6-b8db-4b13-9c72-f05559fcff3f req-0df4d07b-99e3-45ba-9afb-e9bd94a62e3b tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1367.579996] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1367.579996] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.579996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.579996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.579996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.579996] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.579996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.579996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.579996] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.580568] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.580568] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.082403] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.584303] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.086562] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.086768] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.086813] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.087019] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.087116] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.087219] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1369.117656] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.117832] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.117875] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.118106] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.118256] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.127226] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1371.139289] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1371.139618] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.580134] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.580481] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.793589] env[65553]: INFO networking_nsxv3.common.synchronization [req-b292894a-7c89-4452-99e6-f601c8b530f6 req-4eb81290-1512-4bba-abfb-f6f8bec6a5ac tempest-ServersTestJSON-678722431 tempest-ServersTestJSON-678722431-project-member] Enqueued Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1373.793589] env[65553]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a with Priority: HIGHEST for action security_group_members [ 1373.793589] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f1bcf27-527e-4011-8166-1643df6e3b9a taken with stack trace [, , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.793589] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.794026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.794026] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.794189] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.794189] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.794320] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.794387] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.794469] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.794561] env[65553]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f1bcf27-527e-4011-8166-1643df6e3b9a',) {} {{(pid=65553) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.297379] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.297733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.297733] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.297972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.297972] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.298139] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.298239] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.298296] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.298406] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.298502] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.298583] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a is going to be updated. [ 1374.328888] env[65553]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65553) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.329113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.329113] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.329323] env[65553]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.329453] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.337980] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: IN_PROGRESS for 2s [ 1376.349273] env[65553]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a in Status: SUCCESS [ 1376.349703] env[65553]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f1bcf27-527e-4011-8166-1643df6e3b9a deletion is rescheduled due to dependency. [ 1376.349703] env[65553]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f1bcf27-527e-4011-8166-1643df6e3b9a" {{(pid=65553) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.793654] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.794130] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.794439] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.794860] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.795330] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.795777] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.796697] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.797231] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.798114] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.798502] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.799516] env[65553]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.799900] env[65553]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0